2023-07-17 13:10:50,303 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-17 13:10:50,568 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40 2023-07-17 13:10:50,568 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-17 13:10:50,569 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-17 13:10:50,609 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-17 13:10:50,893 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-17 13:10:50,893 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec, deleteOnExit=true 2023-07-17 13:10:50,893 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-17 13:10:50,894 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/test.cache.data in system properties and HBase conf 2023-07-17 13:10:50,894 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 13:10:50,895 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop.log.dir in system properties and HBase conf 2023-07-17 13:10:50,895 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 13:10:50,895 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 13:10:50,896 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 13:10:51,323 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-17 13:10:51,331 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 13:10:51,331 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 13:10:51,332 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 13:10:51,332 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 13:10:51,333 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 13:10:51,333 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 13:10:51,334 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 13:10:51,334 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 13:10:51,334 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 13:10:51,335 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/nfs.dump.dir in system properties and HBase conf 2023-07-17 13:10:51,335 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/java.io.tmpdir in system properties and HBase conf 2023-07-17 13:10:51,336 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 13:10:51,336 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 13:10:51,336 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-17 13:10:52,042 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 13:10:52,047 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 13:10:52,407 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-17 13:10:52,610 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-17 13:10:52,626 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:10:52,681 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:10:52,733 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/java.io.tmpdir/Jetty_localhost_36845_hdfs____h5waow/webapp 2023-07-17 13:10:52,889 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36845 2023-07-17 13:10:52,902 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-17 13:10:52,903 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-17 13:10:53,473 WARN [Listener at localhost/42441] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 13:10:53,570 WARN [Listener at localhost/42441] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 13:10:53,594 WARN [Listener at localhost/42441] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:10:53,661 INFO [Listener at localhost/42441] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:10:53,670 INFO [Listener at localhost/42441] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/java.io.tmpdir/Jetty_localhost_40411_datanode____smgncv/webapp 2023-07-17 13:10:53,810 INFO [Listener at localhost/42441] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40411 2023-07-17 13:10:54,355 WARN [Listener at localhost/39755] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 13:10:54,390 WARN [Listener at localhost/39755] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 13:10:54,398 WARN [Listener at localhost/39755] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:10:54,401 INFO [Listener at localhost/39755] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:10:54,419 INFO [Listener at localhost/39755] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/java.io.tmpdir/Jetty_localhost_38979_datanode____.pmlpdv/webapp 2023-07-17 13:10:54,549 INFO [Listener at localhost/39755] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38979 2023-07-17 13:10:54,570 WARN [Listener at localhost/33621] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 13:10:54,641 WARN [Listener at localhost/33621] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-17 13:10:54,645 WARN [Listener at localhost/33621] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:10:54,646 INFO [Listener at localhost/33621] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:10:54,660 INFO [Listener at localhost/33621] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/java.io.tmpdir/Jetty_localhost_41211_datanode____.tom06c/webapp 2023-07-17 13:10:54,792 INFO [Listener at localhost/33621] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41211 2023-07-17 13:10:54,811 WARN [Listener at localhost/37125] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-17 13:10:55,177 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7ccc23d2e1b3d2b1: Processing first storage report for DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f from datanode b7a0307b-1e64-4b68-bd96-9d64ea240dee 2023-07-17 13:10:55,179 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7ccc23d2e1b3d2b1: from storage DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f node DatanodeRegistration(127.0.0.1:35237, datanodeUuid=b7a0307b-1e64-4b68-bd96-9d64ea240dee, infoPort=41581, infoSecurePort=0, ipcPort=39755, storageInfo=lv=-57;cid=testClusterID;nsid=1886400849;c=1689599452137), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,180 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd8889f392233f453: Processing first storage report for DS-55d137d2-aa0b-47db-a71f-2c1b3b616025 from datanode eac0df03-528f-4964-ace4-2670b845cc12 2023-07-17 13:10:55,180 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd8889f392233f453: from storage DS-55d137d2-aa0b-47db-a71f-2c1b3b616025 node DatanodeRegistration(127.0.0.1:45253, datanodeUuid=eac0df03-528f-4964-ace4-2670b845cc12, infoPort=40387, infoSecurePort=0, ipcPort=37125, storageInfo=lv=-57;cid=testClusterID;nsid=1886400849;c=1689599452137), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,180 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd770af947a310c59: Processing first storage report for DS-28fd3bff-d445-4597-8f45-d4487797325e from datanode abdcd795-709d-4f6e-a096-f1fdb02d44e6 2023-07-17 13:10:55,180 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd770af947a310c59: from storage DS-28fd3bff-d445-4597-8f45-d4487797325e node DatanodeRegistration(127.0.0.1:34453, datanodeUuid=abdcd795-709d-4f6e-a096-f1fdb02d44e6, infoPort=33731, infoSecurePort=0, ipcPort=33621, storageInfo=lv=-57;cid=testClusterID;nsid=1886400849;c=1689599452137), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,180 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7ccc23d2e1b3d2b1: Processing first storage report for DS-4f1d50f1-51b6-471c-b853-498627d8a4bc from datanode b7a0307b-1e64-4b68-bd96-9d64ea240dee 2023-07-17 13:10:55,181 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7ccc23d2e1b3d2b1: from storage DS-4f1d50f1-51b6-471c-b853-498627d8a4bc node DatanodeRegistration(127.0.0.1:35237, datanodeUuid=b7a0307b-1e64-4b68-bd96-9d64ea240dee, infoPort=41581, infoSecurePort=0, ipcPort=39755, storageInfo=lv=-57;cid=testClusterID;nsid=1886400849;c=1689599452137), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,181 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd8889f392233f453: Processing first storage report for DS-99419e45-cc9f-4fed-95a8-90ff93379868 from datanode eac0df03-528f-4964-ace4-2670b845cc12 2023-07-17 13:10:55,181 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd8889f392233f453: from storage DS-99419e45-cc9f-4fed-95a8-90ff93379868 node DatanodeRegistration(127.0.0.1:45253, datanodeUuid=eac0df03-528f-4964-ace4-2670b845cc12, infoPort=40387, infoSecurePort=0, ipcPort=37125, storageInfo=lv=-57;cid=testClusterID;nsid=1886400849;c=1689599452137), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,181 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd770af947a310c59: Processing first storage report for DS-686cc586-2814-4802-ad15-6d662bff0d16 from datanode abdcd795-709d-4f6e-a096-f1fdb02d44e6 2023-07-17 13:10:55,181 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd770af947a310c59: from storage DS-686cc586-2814-4802-ad15-6d662bff0d16 node DatanodeRegistration(127.0.0.1:34453, datanodeUuid=abdcd795-709d-4f6e-a096-f1fdb02d44e6, infoPort=33731, infoSecurePort=0, ipcPort=33621, storageInfo=lv=-57;cid=testClusterID;nsid=1886400849;c=1689599452137), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-17 13:10:55,402 DEBUG [Listener at localhost/37125] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40 2023-07-17 13:10:55,498 INFO [Listener at localhost/37125] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/zookeeper_0, clientPort=62970, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-17 13:10:55,526 INFO [Listener at localhost/37125] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62970 2023-07-17 13:10:55,538 INFO [Listener at localhost/37125] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:55,541 INFO [Listener at localhost/37125] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:56,288 INFO [Listener at localhost/37125] util.FSUtils(471): Created version file at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 with version=8 2023-07-17 13:10:56,289 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/hbase-staging 2023-07-17 13:10:56,698 INFO [Listener at localhost/37125] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-17 13:10:57,341 INFO [Listener at localhost/37125] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 13:10:57,374 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:57,375 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:57,375 INFO [Listener at localhost/37125] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 13:10:57,375 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:57,375 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 13:10:57,537 INFO [Listener at localhost/37125] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 13:10:57,630 DEBUG [Listener at localhost/37125] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-17 13:10:57,751 INFO [Listener at localhost/37125] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42365 2023-07-17 13:10:57,765 INFO [Listener at localhost/37125] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:57,767 INFO [Listener at localhost/37125] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:57,797 INFO [Listener at localhost/37125] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42365 connecting to ZooKeeper ensemble=127.0.0.1:62970 2023-07-17 13:10:57,864 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:423650x0, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 13:10:57,867 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42365-0x101736833f10000 connected 2023-07-17 13:10:57,925 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 13:10:57,927 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:10:57,942 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 13:10:57,952 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42365 2023-07-17 13:10:57,953 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42365 2023-07-17 13:10:57,953 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42365 2023-07-17 13:10:57,957 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42365 2023-07-17 13:10:57,957 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42365 2023-07-17 13:10:57,966 INFO [Listener at localhost/37125] master.HMaster(444): hbase.rootdir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295, hbase.cluster.distributed=false 2023-07-17 13:10:58,048 INFO [Listener at localhost/37125] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 13:10:58,049 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,049 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,049 INFO [Listener at localhost/37125] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 13:10:58,049 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,049 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 13:10:58,054 INFO [Listener at localhost/37125] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 13:10:58,058 INFO [Listener at localhost/37125] ipc.NettyRpcServer(120): Bind to /172.31.14.131:32803 2023-07-17 13:10:58,062 INFO [Listener at localhost/37125] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 13:10:58,074 INFO [Listener at localhost/37125] mob.MobFileCache(124): MobFileCache disabled 2023-07-17 13:10:58,075 INFO [Listener at localhost/37125] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,078 INFO [Listener at localhost/37125] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,080 INFO [Listener at localhost/37125] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:32803 connecting to ZooKeeper ensemble=127.0.0.1:62970 2023-07-17 13:10:58,088 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:328030x0, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 13:10:58,089 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): regionserver:328030x0, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 13:10:58,091 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): regionserver:328030x0, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:10:58,092 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:32803-0x101736833f10001 connected 2023-07-17 13:10:58,092 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 13:10:58,099 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=32803 2023-07-17 13:10:58,103 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=32803 2023-07-17 13:10:58,104 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=32803 2023-07-17 13:10:58,107 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=32803 2023-07-17 13:10:58,108 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=32803 2023-07-17 13:10:58,123 INFO [Listener at localhost/37125] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 13:10:58,123 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,123 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,124 INFO [Listener at localhost/37125] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 13:10:58,124 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,125 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 13:10:58,125 INFO [Listener at localhost/37125] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 13:10:58,128 INFO [Listener at localhost/37125] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37517 2023-07-17 13:10:58,128 INFO [Listener at localhost/37125] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 13:10:58,131 INFO [Listener at localhost/37125] mob.MobFileCache(124): MobFileCache disabled 2023-07-17 13:10:58,132 INFO [Listener at localhost/37125] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,136 INFO [Listener at localhost/37125] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,140 INFO [Listener at localhost/37125] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37517 connecting to ZooKeeper ensemble=127.0.0.1:62970 2023-07-17 13:10:58,145 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:375170x0, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 13:10:58,146 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37517-0x101736833f10002 connected 2023-07-17 13:10:58,146 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 13:10:58,148 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:10:58,149 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 13:10:58,155 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37517 2023-07-17 13:10:58,155 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37517 2023-07-17 13:10:58,156 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37517 2023-07-17 13:10:58,158 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37517 2023-07-17 13:10:58,159 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37517 2023-07-17 13:10:58,172 INFO [Listener at localhost/37125] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-17 13:10:58,172 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,173 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,173 INFO [Listener at localhost/37125] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-17 13:10:58,173 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-17 13:10:58,173 INFO [Listener at localhost/37125] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-17 13:10:58,173 INFO [Listener at localhost/37125] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-17 13:10:58,176 INFO [Listener at localhost/37125] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39513 2023-07-17 13:10:58,176 INFO [Listener at localhost/37125] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-17 13:10:58,177 INFO [Listener at localhost/37125] mob.MobFileCache(124): MobFileCache disabled 2023-07-17 13:10:58,179 INFO [Listener at localhost/37125] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,181 INFO [Listener at localhost/37125] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,183 INFO [Listener at localhost/37125] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39513 connecting to ZooKeeper ensemble=127.0.0.1:62970 2023-07-17 13:10:58,187 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:395130x0, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-17 13:10:58,195 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39513-0x101736833f10003 connected 2023-07-17 13:10:58,195 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 13:10:58,196 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:10:58,197 DEBUG [Listener at localhost/37125] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-17 13:10:58,197 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39513 2023-07-17 13:10:58,198 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39513 2023-07-17 13:10:58,198 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39513 2023-07-17 13:10:58,198 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39513 2023-07-17 13:10:58,198 DEBUG [Listener at localhost/37125] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39513 2023-07-17 13:10:58,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42365,1689599456474 2023-07-17 13:10:58,211 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 13:10:58,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42365,1689599456474 2023-07-17 13:10:58,240 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 13:10:58,240 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 13:10:58,240 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 13:10:58,243 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 13:10:58,245 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42365,1689599456474 from backup master directory 2023-07-17 13:10:58,240 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-17 13:10:58,251 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-17 13:10:58,240 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:58,251 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42365,1689599456474 2023-07-17 13:10:58,251 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-17 13:10:58,252 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 13:10:58,252 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42365,1689599456474 2023-07-17 13:10:58,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-17 13:10:58,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-17 13:10:58,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/hbase.id with ID: 05e3eb0b-7d06-436d-80ae-6e2efc32adf3 2023-07-17 13:10:58,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-17 13:10:58,483 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:58,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x65ac29dd to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:10:58,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3fd0a804, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:10:58,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 13:10:58,622 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-17 13:10:58,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-17 13:10:58,653 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-17 13:10:58,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 13:10:58,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-17 13:10:58,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 13:10:58,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/data/master/store-tmp 2023-07-17 13:10:58,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:10:58,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 13:10:58,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:10:58,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:10:58,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 13:10:58,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:10:58,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:10:58,758 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 13:10:58,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/WALs/jenkins-hbase4.apache.org,42365,1689599456474 2023-07-17 13:10:58,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42365%2C1689599456474, suffix=, logDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/WALs/jenkins-hbase4.apache.org,42365,1689599456474, archiveDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/oldWALs, maxLogs=10 2023-07-17 13:10:58,861 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35237,DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f,DISK] 2023-07-17 13:10:58,863 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45253,DS-55d137d2-aa0b-47db-a71f-2c1b3b616025,DISK] 2023-07-17 13:10:58,864 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34453,DS-28fd3bff-d445-4597-8f45-d4487797325e,DISK] 2023-07-17 13:10:58,873 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-17 13:10:58,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/WALs/jenkins-hbase4.apache.org,42365,1689599456474/jenkins-hbase4.apache.org%2C42365%2C1689599456474.1689599458797 2023-07-17 13:10:58,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34453,DS-28fd3bff-d445-4597-8f45-d4487797325e,DISK], DatanodeInfoWithStorage[127.0.0.1:35237,DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f,DISK], DatanodeInfoWithStorage[127.0.0.1:45253,DS-55d137d2-aa0b-47db-a71f-2c1b3b616025,DISK]] 2023-07-17 13:10:58,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-17 13:10:58,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:10:58,975 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:58,976 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,058 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,071 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-17 13:10:59,109 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-17 13:10:59,122 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:10:59,129 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,131 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,148 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-17 13:10:59,152 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:10:59,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62224729, jitterRate=-0.07277928292751312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:10:59,154 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 13:10:59,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-17 13:10:59,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-17 13:10:59,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-17 13:10:59,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-17 13:10:59,193 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-17 13:10:59,246 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 52 msec 2023-07-17 13:10:59,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-17 13:10:59,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-17 13:10:59,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-17 13:10:59,324 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-17 13:10:59,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-17 13:10:59,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-17 13:10:59,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-17 13:10:59,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-17 13:10:59,347 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:59,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-17 13:10:59,349 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-17 13:10:59,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-17 13:10:59,375 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 13:10:59,375 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 13:10:59,375 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 13:10:59,375 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-17 13:10:59,376 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:59,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42365,1689599456474, sessionid=0x101736833f10000, setting cluster-up flag (Was=false) 2023-07-17 13:10:59,400 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:59,409 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-17 13:10:59,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42365,1689599456474 2023-07-17 13:10:59,422 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:10:59,440 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-17 13:10:59,443 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42365,1689599456474 2023-07-17 13:10:59,447 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp 2023-07-17 13:10:59,508 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(951): ClusterId : 05e3eb0b-7d06-436d-80ae-6e2efc32adf3 2023-07-17 13:10:59,521 INFO [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(951): ClusterId : 05e3eb0b-7d06-436d-80ae-6e2efc32adf3 2023-07-17 13:10:59,522 INFO [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(951): ClusterId : 05e3eb0b-7d06-436d-80ae-6e2efc32adf3 2023-07-17 13:10:59,526 DEBUG [RS:0;jenkins-hbase4:32803] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 13:10:59,526 DEBUG [RS:2;jenkins-hbase4:39513] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 13:10:59,526 DEBUG [RS:1;jenkins-hbase4:37517] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-17 13:10:59,540 DEBUG [RS:1;jenkins-hbase4:37517] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 13:10:59,540 DEBUG [RS:1;jenkins-hbase4:37517] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 13:10:59,541 DEBUG [RS:2;jenkins-hbase4:39513] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 13:10:59,542 DEBUG [RS:2;jenkins-hbase4:39513] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 13:10:59,544 DEBUG [RS:0;jenkins-hbase4:32803] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-17 13:10:59,544 DEBUG [RS:0;jenkins-hbase4:32803] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-17 13:10:59,554 DEBUG [RS:2;jenkins-hbase4:39513] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 13:10:59,555 DEBUG [RS:2;jenkins-hbase4:39513] zookeeper.ReadOnlyZKClient(139): Connect 0x25af0fff to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:10:59,554 DEBUG [RS:1;jenkins-hbase4:37517] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 13:10:59,560 DEBUG [RS:0;jenkins-hbase4:32803] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-17 13:10:59,570 DEBUG [RS:1;jenkins-hbase4:37517] zookeeper.ReadOnlyZKClient(139): Connect 0x2411f5c7 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:10:59,571 DEBUG [RS:0;jenkins-hbase4:32803] zookeeper.ReadOnlyZKClient(139): Connect 0x4ff98d89 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:10:59,600 DEBUG [RS:1;jenkins-hbase4:37517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ad60f35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:10:59,601 DEBUG [RS:1;jenkins-hbase4:37517] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ee99eb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 13:10:59,602 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-17 13:10:59,608 DEBUG [RS:2;jenkins-hbase4:39513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b68e53a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:10:59,608 DEBUG [RS:2;jenkins-hbase4:39513] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f57648f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 13:10:59,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:10:59,610 DEBUG [RS:0;jenkins-hbase4:32803] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@413e6a06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:10:59,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-17 13:10:59,611 DEBUG [RS:0;jenkins-hbase4:32803] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3603d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 13:10:59,635 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:37517 2023-07-17 13:10:59,639 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:32803 2023-07-17 13:10:59,635 DEBUG [RS:2;jenkins-hbase4:39513] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:39513 2023-07-17 13:10:59,648 INFO [RS:2;jenkins-hbase4:39513] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 13:10:59,648 INFO [RS:2;jenkins-hbase4:39513] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 13:10:59,649 INFO [RS:0;jenkins-hbase4:32803] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 13:10:59,649 INFO [RS:0;jenkins-hbase4:32803] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 13:10:59,649 DEBUG [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 13:10:59,649 INFO [RS:1;jenkins-hbase4:37517] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-17 13:10:59,650 INFO [RS:1;jenkins-hbase4:37517] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-17 13:10:59,650 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 13:10:59,651 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-17 13:10:59,650 INFO [RS:2;jenkins-hbase4:39513] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:10:59,653 DEBUG [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 13:10:59,651 INFO [RS:0;jenkins-hbase4:32803] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:10:59,651 INFO [RS:1;jenkins-hbase4:37517] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:10:59,655 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 13:10:59,655 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1022): About to register with Master. 2023-07-17 13:10:59,656 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42365,1689599456474 with isa=jenkins-hbase4.apache.org/172.31.14.131:32803, startcode=1689599458048 2023-07-17 13:10:59,656 INFO [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42365,1689599456474 with isa=jenkins-hbase4.apache.org/172.31.14.131:37517, startcode=1689599458122 2023-07-17 13:10:59,656 INFO [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42365,1689599456474 with isa=jenkins-hbase4.apache.org/172.31.14.131:39513, startcode=1689599458171 2023-07-17 13:10:59,685 DEBUG [RS:0;jenkins-hbase4:32803] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 13:10:59,685 DEBUG [RS:2;jenkins-hbase4:39513] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 13:10:59,685 DEBUG [RS:1;jenkins-hbase4:37517] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-17 13:10:59,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-17 13:10:59,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 13:10:59,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 13:10:59,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 13:10:59,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-17 13:10:59,797 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-17 13:10:59,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:10:59,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 13:10:59,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:10:59,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1689599489816 2023-07-17 13:10:59,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-17 13:10:59,827 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47459, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 13:10:59,828 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 13:10:59,827 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45741, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 13:10:59,827 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56571, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-17 13:10:59,829 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-17 13:10:59,838 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 13:10:59,839 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42365] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 13:10:59,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-17 13:10:59,861 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42365] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 13:10:59,862 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42365] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-17 13:10:59,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-17 13:10:59,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-17 13:10:59,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-17 13:10:59,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-17 13:10:59,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 13:10:59,889 DEBUG [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 13:10:59,889 WARN [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 13:10:59,890 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 13:10:59,890 WARN [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 13:10:59,890 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(2830): Master is not running yet 2023-07-17 13:10:59,891 WARN [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-17 13:10:59,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-17 13:10:59,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-17 13:10:59,898 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-17 13:10:59,903 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-17 13:10:59,904 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-17 13:10:59,913 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689599459906,5,FailOnTimeoutGroup] 2023-07-17 13:10:59,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689599459914,5,FailOnTimeoutGroup] 2023-07-17 13:10:59,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-17 13:10:59,916 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-17 13:10:59,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-17 13:10:59,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-17 13:10:59,943 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 13:10:59,944 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-17 13:10:59,944 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:10:59,994 INFO [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42365,1689599456474 with isa=jenkins-hbase4.apache.org/172.31.14.131:37517, startcode=1689599458122 2023-07-17 13:10:59,994 INFO [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42365,1689599456474 with isa=jenkins-hbase4.apache.org/172.31.14.131:39513, startcode=1689599458171 2023-07-17 13:10:59,999 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42365,1689599456474 with isa=jenkins-hbase4.apache.org/172.31.14.131:32803, startcode=1689599458048 2023-07-17 13:11:00,009 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42365] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:00,012 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:00,015 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42365] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:00,016 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42365] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:00,019 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:11:00,019 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42441 2023-07-17 13:11:00,019 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 13:11:00,023 DEBUG [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:11:00,019 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 13:11:00,023 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:11:00,024 DEBUG [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42441 2023-07-17 13:11:00,025 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:42441 2023-07-17 13:11:00,025 DEBUG [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 13:11:00,025 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-17 13:11:00,027 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:11:00,028 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/info 2023-07-17 13:11:00,029 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 13:11:00,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,031 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 13:11:00,031 DEBUG [RS:1;jenkins-hbase4:37517] zookeeper.ZKUtil(162): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:00,032 WARN [RS:1;jenkins-hbase4:37517] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 13:11:00,032 INFO [RS:1;jenkins-hbase4:37517] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 13:11:00,032 DEBUG [RS:2;jenkins-hbase4:39513] zookeeper.ZKUtil(162): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:00,032 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:00,032 DEBUG [RS:0;jenkins-hbase4:32803] zookeeper.ZKUtil(162): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:00,032 WARN [RS:2;jenkins-hbase4:39513] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 13:11:00,033 WARN [RS:0;jenkins-hbase4:32803] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-17 13:11:00,033 INFO [RS:2;jenkins-hbase4:39513] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 13:11:00,033 INFO [RS:0;jenkins-hbase4:32803] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 13:11:00,034 DEBUG [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:00,034 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39513,1689599458171] 2023-07-17 13:11:00,035 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,32803,1689599458048] 2023-07-17 13:11:00,034 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1948): logDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:00,035 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37517,1689599458122] 2023-07-17 13:11:00,036 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/rep_barrier 2023-07-17 13:11:00,037 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 13:11:00,040 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,041 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 13:11:00,044 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/table 2023-07-17 13:11:00,047 DEBUG [RS:2;jenkins-hbase4:39513] zookeeper.ZKUtil(162): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:00,049 DEBUG [RS:0;jenkins-hbase4:32803] zookeeper.ZKUtil(162): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:00,049 DEBUG [RS:1;jenkins-hbase4:37517] zookeeper.ZKUtil(162): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:00,049 DEBUG [RS:2;jenkins-hbase4:39513] zookeeper.ZKUtil(162): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:00,049 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 13:11:00,050 DEBUG [RS:1;jenkins-hbase4:37517] zookeeper.ZKUtil(162): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:00,050 DEBUG [RS:0;jenkins-hbase4:32803] zookeeper.ZKUtil(162): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:00,051 DEBUG [RS:1;jenkins-hbase4:37517] zookeeper.ZKUtil(162): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:00,051 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,051 DEBUG [RS:2;jenkins-hbase4:39513] zookeeper.ZKUtil(162): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:00,055 DEBUG [RS:0;jenkins-hbase4:32803] zookeeper.ZKUtil(162): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:00,059 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740 2023-07-17 13:11:00,060 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740 2023-07-17 13:11:00,067 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 13:11:00,070 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 13:11:00,072 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 13:11:00,075 DEBUG [RS:2;jenkins-hbase4:39513] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 13:11:00,076 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:00,075 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-17 13:11:00,077 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60595029, jitterRate=-0.09706370532512665}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 13:11:00,077 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 13:11:00,077 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 13:11:00,077 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 13:11:00,077 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 13:11:00,078 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 13:11:00,078 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 13:11:00,083 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 13:11:00,083 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 13:11:00,084 INFO [RS:2;jenkins-hbase4:39513] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 13:11:00,084 INFO [RS:0;jenkins-hbase4:32803] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 13:11:00,084 INFO [RS:1;jenkins-hbase4:37517] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-17 13:11:00,090 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-17 13:11:00,090 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-17 13:11:00,107 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-17 13:11:00,121 INFO [RS:2;jenkins-hbase4:39513] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 13:11:00,121 INFO [RS:1;jenkins-hbase4:37517] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 13:11:00,121 INFO [RS:0;jenkins-hbase4:32803] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-17 13:11:00,140 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-17 13:11:00,146 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-17 13:11:00,149 INFO [RS:1;jenkins-hbase4:37517] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 13:11:00,150 INFO [RS:0;jenkins-hbase4:32803] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 13:11:00,149 INFO [RS:2;jenkins-hbase4:39513] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-17 13:11:00,150 INFO [RS:0;jenkins-hbase4:32803] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,150 INFO [RS:1;jenkins-hbase4:37517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,151 INFO [RS:2;jenkins-hbase4:39513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,155 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 13:11:00,158 INFO [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 13:11:00,166 INFO [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-17 13:11:00,175 INFO [RS:0;jenkins-hbase4:32803] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,175 INFO [RS:2;jenkins-hbase4:39513] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,175 INFO [RS:1;jenkins-hbase4:37517] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,175 DEBUG [RS:0;jenkins-hbase4:32803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,175 DEBUG [RS:2;jenkins-hbase4:39513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,176 DEBUG [RS:0;jenkins-hbase4:32803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,176 DEBUG [RS:1;jenkins-hbase4:37517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,176 DEBUG [RS:0;jenkins-hbase4:32803] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,176 DEBUG [RS:1;jenkins-hbase4:37517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,176 DEBUG [RS:0;jenkins-hbase4:32803] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,176 DEBUG [RS:1;jenkins-hbase4:37517] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,176 DEBUG [RS:0;jenkins-hbase4:32803] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,176 DEBUG [RS:1;jenkins-hbase4:37517] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,176 DEBUG [RS:0;jenkins-hbase4:32803] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 13:11:00,177 DEBUG [RS:1;jenkins-hbase4:37517] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,177 DEBUG [RS:0;jenkins-hbase4:32803] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,177 DEBUG [RS:1;jenkins-hbase4:37517] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 13:11:00,177 DEBUG [RS:0;jenkins-hbase4:32803] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,177 DEBUG [RS:1;jenkins-hbase4:37517] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,177 DEBUG [RS:0;jenkins-hbase4:32803] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,177 DEBUG [RS:1;jenkins-hbase4:37517] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,177 DEBUG [RS:0;jenkins-hbase4:32803] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,177 DEBUG [RS:1;jenkins-hbase4:37517] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,176 DEBUG [RS:2;jenkins-hbase4:39513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,177 DEBUG [RS:1;jenkins-hbase4:37517] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,177 DEBUG [RS:2;jenkins-hbase4:39513] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,178 DEBUG [RS:2;jenkins-hbase4:39513] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,178 DEBUG [RS:2;jenkins-hbase4:39513] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,178 DEBUG [RS:2;jenkins-hbase4:39513] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-17 13:11:00,178 DEBUG [RS:2;jenkins-hbase4:39513] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,178 DEBUG [RS:2;jenkins-hbase4:39513] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,178 DEBUG [RS:2;jenkins-hbase4:39513] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,178 DEBUG [RS:2;jenkins-hbase4:39513] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-17 13:11:00,181 INFO [RS:0;jenkins-hbase4:32803] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,181 INFO [RS:0;jenkins-hbase4:32803] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,181 INFO [RS:0;jenkins-hbase4:32803] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,196 INFO [RS:1;jenkins-hbase4:37517] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,196 INFO [RS:1;jenkins-hbase4:37517] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,196 INFO [RS:1;jenkins-hbase4:37517] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,226 INFO [RS:2;jenkins-hbase4:39513] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,226 INFO [RS:2;jenkins-hbase4:39513] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,226 INFO [RS:2;jenkins-hbase4:39513] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,232 INFO [RS:1;jenkins-hbase4:37517] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 13:11:00,235 INFO [RS:1;jenkins-hbase4:37517] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37517,1689599458122-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,236 INFO [RS:0;jenkins-hbase4:32803] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 13:11:00,259 INFO [RS:0;jenkins-hbase4:32803] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,32803,1689599458048-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,262 INFO [RS:2;jenkins-hbase4:39513] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-17 13:11:00,262 INFO [RS:2;jenkins-hbase4:39513] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39513,1689599458171-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,277 INFO [RS:1;jenkins-hbase4:37517] regionserver.Replication(203): jenkins-hbase4.apache.org,37517,1689599458122 started 2023-07-17 13:11:00,277 INFO [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,37517,1689599458122, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37517, sessionid=0x101736833f10002 2023-07-17 13:11:00,278 INFO [RS:0;jenkins-hbase4:32803] regionserver.Replication(203): jenkins-hbase4.apache.org,32803,1689599458048 started 2023-07-17 13:11:00,278 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,32803,1689599458048, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:32803, sessionid=0x101736833f10001 2023-07-17 13:11:00,278 DEBUG [RS:1;jenkins-hbase4:37517] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 13:11:00,279 DEBUG [RS:0;jenkins-hbase4:32803] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 13:11:00,279 DEBUG [RS:1;jenkins-hbase4:37517] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:00,280 DEBUG [RS:1;jenkins-hbase4:37517] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37517,1689599458122' 2023-07-17 13:11:00,280 DEBUG [RS:1;jenkins-hbase4:37517] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 13:11:00,279 DEBUG [RS:0;jenkins-hbase4:32803] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:00,280 DEBUG [RS:0;jenkins-hbase4:32803] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32803,1689599458048' 2023-07-17 13:11:00,281 DEBUG [RS:0;jenkins-hbase4:32803] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 13:11:00,282 DEBUG [RS:1;jenkins-hbase4:37517] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 13:11:00,283 DEBUG [RS:1;jenkins-hbase4:37517] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 13:11:00,283 DEBUG [RS:1;jenkins-hbase4:37517] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 13:11:00,283 DEBUG [RS:1;jenkins-hbase4:37517] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:00,283 DEBUG [RS:1;jenkins-hbase4:37517] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37517,1689599458122' 2023-07-17 13:11:00,283 DEBUG [RS:1;jenkins-hbase4:37517] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:00,282 DEBUG [RS:0;jenkins-hbase4:32803] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 13:11:00,284 DEBUG [RS:1;jenkins-hbase4:37517] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:00,284 DEBUG [RS:0;jenkins-hbase4:32803] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 13:11:00,284 DEBUG [RS:0;jenkins-hbase4:32803] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 13:11:00,284 DEBUG [RS:1;jenkins-hbase4:37517] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 13:11:00,284 INFO [RS:1;jenkins-hbase4:37517] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 13:11:00,285 INFO [RS:1;jenkins-hbase4:37517] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 13:11:00,294 INFO [RS:2;jenkins-hbase4:39513] regionserver.Replication(203): jenkins-hbase4.apache.org,39513,1689599458171 started 2023-07-17 13:11:00,294 INFO [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39513,1689599458171, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39513, sessionid=0x101736833f10003 2023-07-17 13:11:00,294 DEBUG [RS:2;jenkins-hbase4:39513] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-17 13:11:00,294 DEBUG [RS:2;jenkins-hbase4:39513] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:00,294 DEBUG [RS:2;jenkins-hbase4:39513] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39513,1689599458171' 2023-07-17 13:11:00,294 DEBUG [RS:2;jenkins-hbase4:39513] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-17 13:11:00,295 DEBUG [RS:2;jenkins-hbase4:39513] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-17 13:11:00,296 DEBUG [RS:2;jenkins-hbase4:39513] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-17 13:11:00,296 DEBUG [RS:2;jenkins-hbase4:39513] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-17 13:11:00,284 DEBUG [RS:0;jenkins-hbase4:32803] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:00,297 DEBUG [RS:0;jenkins-hbase4:32803] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,32803,1689599458048' 2023-07-17 13:11:00,296 DEBUG [RS:2;jenkins-hbase4:39513] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:00,297 DEBUG [RS:0;jenkins-hbase4:32803] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:00,297 DEBUG [RS:2;jenkins-hbase4:39513] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39513,1689599458171' 2023-07-17 13:11:00,297 DEBUG [RS:2;jenkins-hbase4:39513] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:00,298 DEBUG [RS:2;jenkins-hbase4:39513] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:00,298 DEBUG [RS:0;jenkins-hbase4:32803] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:00,298 DEBUG [RS:2;jenkins-hbase4:39513] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 13:11:00,299 DEBUG [RS:0;jenkins-hbase4:32803] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-17 13:11:00,298 INFO [RS:2;jenkins-hbase4:39513] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 13:11:00,299 INFO [RS:0;jenkins-hbase4:32803] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-17 13:11:00,300 INFO [RS:2;jenkins-hbase4:39513] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 13:11:00,300 INFO [RS:0;jenkins-hbase4:32803] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-17 13:11:00,308 DEBUG [jenkins-hbase4:42365] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-17 13:11:00,314 DEBUG [jenkins-hbase4:42365] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:00,325 DEBUG [jenkins-hbase4:42365] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:00,325 DEBUG [jenkins-hbase4:42365] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:00,325 DEBUG [jenkins-hbase4:42365] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:00,325 DEBUG [jenkins-hbase4:42365] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:00,333 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37517,1689599458122, state=OPENING 2023-07-17 13:11:00,344 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-17 13:11:00,347 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:11:00,348 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 13:11:00,356 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:11:00,399 INFO [RS:1;jenkins-hbase4:37517] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37517%2C1689599458122, suffix=, logDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,37517,1689599458122, archiveDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/oldWALs, maxLogs=32 2023-07-17 13:11:00,409 INFO [RS:2;jenkins-hbase4:39513] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39513%2C1689599458171, suffix=, logDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,39513,1689599458171, archiveDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/oldWALs, maxLogs=32 2023-07-17 13:11:00,412 INFO [RS:0;jenkins-hbase4:32803] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C32803%2C1689599458048, suffix=, logDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,32803,1689599458048, archiveDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/oldWALs, maxLogs=32 2023-07-17 13:11:00,438 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35237,DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f,DISK] 2023-07-17 13:11:00,438 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34453,DS-28fd3bff-d445-4597-8f45-d4487797325e,DISK] 2023-07-17 13:11:00,439 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45253,DS-55d137d2-aa0b-47db-a71f-2c1b3b616025,DISK] 2023-07-17 13:11:00,463 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35237,DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f,DISK] 2023-07-17 13:11:00,463 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45253,DS-55d137d2-aa0b-47db-a71f-2c1b3b616025,DISK] 2023-07-17 13:11:00,465 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34453,DS-28fd3bff-d445-4597-8f45-d4487797325e,DISK] 2023-07-17 13:11:00,465 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45253,DS-55d137d2-aa0b-47db-a71f-2c1b3b616025,DISK] 2023-07-17 13:11:00,466 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35237,DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f,DISK] 2023-07-17 13:11:00,467 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34453,DS-28fd3bff-d445-4597-8f45-d4487797325e,DISK] 2023-07-17 13:11:00,471 INFO [RS:1;jenkins-hbase4:37517] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,37517,1689599458122/jenkins-hbase4.apache.org%2C37517%2C1689599458122.1689599460401 2023-07-17 13:11:00,475 DEBUG [RS:1;jenkins-hbase4:37517] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34453,DS-28fd3bff-d445-4597-8f45-d4487797325e,DISK], DatanodeInfoWithStorage[127.0.0.1:35237,DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f,DISK], DatanodeInfoWithStorage[127.0.0.1:45253,DS-55d137d2-aa0b-47db-a71f-2c1b3b616025,DISK]] 2023-07-17 13:11:00,483 INFO [RS:2;jenkins-hbase4:39513] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,39513,1689599458171/jenkins-hbase4.apache.org%2C39513%2C1689599458171.1689599460411 2023-07-17 13:11:00,487 DEBUG [RS:2;jenkins-hbase4:39513] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35237,DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f,DISK], DatanodeInfoWithStorage[127.0.0.1:45253,DS-55d137d2-aa0b-47db-a71f-2c1b3b616025,DISK], DatanodeInfoWithStorage[127.0.0.1:34453,DS-28fd3bff-d445-4597-8f45-d4487797325e,DISK]] 2023-07-17 13:11:00,487 INFO [RS:0;jenkins-hbase4:32803] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,32803,1689599458048/jenkins-hbase4.apache.org%2C32803%2C1689599458048.1689599460414 2023-07-17 13:11:00,490 DEBUG [RS:0;jenkins-hbase4:32803] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45253,DS-55d137d2-aa0b-47db-a71f-2c1b3b616025,DISK], DatanodeInfoWithStorage[127.0.0.1:34453,DS-28fd3bff-d445-4597-8f45-d4487797325e,DISK], DatanodeInfoWithStorage[127.0.0.1:35237,DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f,DISK]] 2023-07-17 13:11:00,558 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:00,561 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:11:00,568 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38240, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:11:00,600 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-17 13:11:00,600 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-17 13:11:00,615 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37517%2C1689599458122.meta, suffix=.meta, logDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,37517,1689599458122, archiveDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/oldWALs, maxLogs=32 2023-07-17 13:11:00,655 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35237,DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f,DISK] 2023-07-17 13:11:00,659 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34453,DS-28fd3bff-d445-4597-8f45-d4487797325e,DISK] 2023-07-17 13:11:00,660 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45253,DS-55d137d2-aa0b-47db-a71f-2c1b3b616025,DISK] 2023-07-17 13:11:00,677 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/WALs/jenkins-hbase4.apache.org,37517,1689599458122/jenkins-hbase4.apache.org%2C37517%2C1689599458122.meta.1689599460617.meta 2023-07-17 13:11:00,678 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35237,DS-879b0f1b-6ae4-4d09-867d-617f9a71d30f,DISK], DatanodeInfoWithStorage[127.0.0.1:34453,DS-28fd3bff-d445-4597-8f45-d4487797325e,DISK], DatanodeInfoWithStorage[127.0.0.1:45253,DS-55d137d2-aa0b-47db-a71f-2c1b3b616025,DISK]] 2023-07-17 13:11:00,679 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-17 13:11:00,680 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-17 13:11:00,683 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:00,684 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-17 13:11:00,687 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-17 13:11:00,689 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-17 13:11:00,710 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-17 13:11:00,711 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:00,711 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-17 13:11:00,712 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-17 13:11:00,716 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-17 13:11:00,722 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/info 2023-07-17 13:11:00,722 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/info 2023-07-17 13:11:00,723 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-17 13:11:00,723 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,724 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-17 13:11:00,725 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/rep_barrier 2023-07-17 13:11:00,725 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/rep_barrier 2023-07-17 13:11:00,726 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-17 13:11:00,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,727 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-17 13:11:00,729 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/table 2023-07-17 13:11:00,730 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/table 2023-07-17 13:11:00,730 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-17 13:11:00,731 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:00,733 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740 2023-07-17 13:11:00,736 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740 2023-07-17 13:11:00,740 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-17 13:11:00,743 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-17 13:11:00,745 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72713747, jitterRate=0.08351926505565643}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-17 13:11:00,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-17 13:11:00,758 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1689599460545 2023-07-17 13:11:00,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-17 13:11:00,783 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-17 13:11:00,788 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37517,1689599458122, state=OPEN 2023-07-17 13:11:00,792 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-17 13:11:00,792 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-17 13:11:00,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-17 13:11:00,799 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37517,1689599458122 in 437 msec 2023-07-17 13:11:00,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-17 13:11:00,810 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 695 msec 2023-07-17 13:11:00,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1950 sec 2023-07-17 13:11:00,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1689599460823, completionTime=-1 2023-07-17 13:11:00,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-17 13:11:00,824 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-17 13:11:00,917 DEBUG [hconnection-0x25a025a3-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:00,922 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:00,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-17 13:11:00,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1689599520949 2023-07-17 13:11:00,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1689599580950 2023-07-17 13:11:00,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 125 msec 2023-07-17 13:11:00,992 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42365,1689599456474-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42365,1689599456474-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42365,1689599456474-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42365, period=300000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:00,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-17 13:11:01,005 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-17 13:11:01,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-17 13:11:01,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 13:11:01,042 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-17 13:11:01,045 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:11:01,049 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:11:01,078 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:11:01,082 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752 empty. 2023-07-17 13:11:01,082 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:11:01,083 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-17 13:11:01,142 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:01,145 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 79c7d7339a0f694eca1cc16099aeb752, NAME => 'hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:11:01,169 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:01,169 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 79c7d7339a0f694eca1cc16099aeb752, disabling compactions & flushes 2023-07-17 13:11:01,169 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:11:01,169 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:11:01,169 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. after waiting 0 ms 2023-07-17 13:11:01,169 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:11:01,169 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:11:01,170 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 79c7d7339a0f694eca1cc16099aeb752: 2023-07-17 13:11:01,175 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:11:01,194 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689599461178"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599461178"}]},"ts":"1689599461178"} 2023-07-17 13:11:01,234 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 13:11:01,236 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:11:01,242 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599461236"}]},"ts":"1689599461236"} 2023-07-17 13:11:01,247 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-17 13:11:01,253 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:01,255 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:01,255 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:01,255 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:01,255 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:01,258 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=79c7d7339a0f694eca1cc16099aeb752, ASSIGN}] 2023-07-17 13:11:01,267 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=79c7d7339a0f694eca1cc16099aeb752, ASSIGN 2023-07-17 13:11:01,272 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=79c7d7339a0f694eca1cc16099aeb752, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32803,1689599458048; forceNewPlan=false, retain=false 2023-07-17 13:11:01,427 INFO [jenkins-hbase4:42365] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 13:11:01,428 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=79c7d7339a0f694eca1cc16099aeb752, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:01,428 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689599461428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599461428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599461428"}]},"ts":"1689599461428"} 2023-07-17 13:11:01,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 79c7d7339a0f694eca1cc16099aeb752, server=jenkins-hbase4.apache.org,32803,1689599458048}] 2023-07-17 13:11:01,588 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:01,589 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:11:01,591 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:11:01,597 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:11:01,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79c7d7339a0f694eca1cc16099aeb752, NAME => 'hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752.', STARTKEY => '', ENDKEY => ''} 2023-07-17 13:11:01,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. service=AccessControlService 2023-07-17 13:11:01,599 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:01,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:11:01,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:01,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:11:01,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:11:01,602 INFO [StoreOpener-79c7d7339a0f694eca1cc16099aeb752-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:11:01,604 DEBUG [StoreOpener-79c7d7339a0f694eca1cc16099aeb752-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752/info 2023-07-17 13:11:01,604 DEBUG [StoreOpener-79c7d7339a0f694eca1cc16099aeb752-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752/info 2023-07-17 13:11:01,605 INFO [StoreOpener-79c7d7339a0f694eca1cc16099aeb752-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79c7d7339a0f694eca1cc16099aeb752 columnFamilyName info 2023-07-17 13:11:01,606 INFO [StoreOpener-79c7d7339a0f694eca1cc16099aeb752-1] regionserver.HStore(310): Store=79c7d7339a0f694eca1cc16099aeb752/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:01,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:11:01,610 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:11:01,615 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:11:01,620 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:01,621 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79c7d7339a0f694eca1cc16099aeb752; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61314194, jitterRate=-0.0863473117351532}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:01,621 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79c7d7339a0f694eca1cc16099aeb752: 2023-07-17 13:11:01,623 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752., pid=6, masterSystemTime=1689599461588 2023-07-17 13:11:01,627 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:11:01,628 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:11:01,629 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=79c7d7339a0f694eca1cc16099aeb752, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:01,630 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1689599461629"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599461629"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599461629"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599461629"}]},"ts":"1689599461629"} 2023-07-17 13:11:01,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-17 13:11:01,636 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 79c7d7339a0f694eca1cc16099aeb752, server=jenkins-hbase4.apache.org,32803,1689599458048 in 200 msec 2023-07-17 13:11:01,640 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-17 13:11:01,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=79c7d7339a0f694eca1cc16099aeb752, ASSIGN in 378 msec 2023-07-17 13:11:01,642 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:11:01,642 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599461642"}]},"ts":"1689599461642"} 2023-07-17 13:11:01,645 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-17 13:11:01,649 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-17 13:11:01,649 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:11:01,650 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-17 13:11:01,651 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:11:01,652 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 626 msec 2023-07-17 13:11:01,671 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:01,674 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38618, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:01,688 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-17 13:11:01,705 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 13:11:01,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-17 13:11:01,721 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-17 13:11:01,732 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-17 13:11:01,739 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-07-17 13:11:01,748 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-17 13:11:01,750 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-17 13:11:01,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.498sec 2023-07-17 13:11:01,754 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-17 13:11:01,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-17 13:11:01,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-17 13:11:01,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42365,1689599456474-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-17 13:11:01,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42365,1689599456474-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-17 13:11:01,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-17 13:11:01,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-17 13:11:01,790 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:11:01,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-17 13:11:01,795 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:11:01,798 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7 2023-07-17 13:11:01,800 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7 empty. 2023-07-17 13:11:01,803 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7 2023-07-17 13:11:01,803 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-17 13:11:01,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 13:11:01,833 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:01,835 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1b89fe16757ad0fa7999b813ad1f00a7, NAME => 'hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:11:01,855 DEBUG [Listener at localhost/37125] zookeeper.ReadOnlyZKClient(139): Connect 0x163e546e to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:01,855 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:01,856 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 1b89fe16757ad0fa7999b813ad1f00a7, disabling compactions & flushes 2023-07-17 13:11:01,856 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:11:01,856 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:11:01,856 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. after waiting 0 ms 2023-07-17 13:11:01,856 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:11:01,856 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:11:01,856 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 1b89fe16757ad0fa7999b813ad1f00a7: 2023-07-17 13:11:01,861 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:11:01,862 DEBUG [Listener at localhost/37125] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@783bbc0f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:01,863 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689599461862"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599461862"}]},"ts":"1689599461862"} 2023-07-17 13:11:01,867 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-17 13:11:01,870 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:11:01,870 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599461870"}]},"ts":"1689599461870"} 2023-07-17 13:11:01,873 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-17 13:11:01,878 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:01,879 DEBUG [hconnection-0x346953fe-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:01,879 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:01,879 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:01,879 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:01,879 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:01,880 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1b89fe16757ad0fa7999b813ad1f00a7, ASSIGN}] 2023-07-17 13:11:01,883 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=1b89fe16757ad0fa7999b813ad1f00a7, ASSIGN 2023-07-17 13:11:01,885 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=1b89fe16757ad0fa7999b813ad1f00a7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32803,1689599458048; forceNewPlan=false, retain=false 2023-07-17 13:11:01,893 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:01,896 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42365,1689599456474 2023-07-17 13:11:01,896 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-17 13:11:01,896 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/test.cache.data in system properties and HBase conf 2023-07-17 13:11:01,896 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop.tmp.dir in system properties and HBase conf 2023-07-17 13:11:01,896 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop.log.dir in system properties and HBase conf 2023-07-17 13:11:01,896 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-17 13:11:01,896 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-17 13:11:01,896 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-17 13:11:01,896 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/nfs.dump.dir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/java.io.tmpdir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-17 13:11:01,897 INFO [Listener at localhost/37125] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-17 13:11:01,911 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 13:11:02,035 INFO [jenkins-hbase4:42365] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 13:11:02,037 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1b89fe16757ad0fa7999b813ad1f00a7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:02,037 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689599462036"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599462036"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599462036"}]},"ts":"1689599462036"} 2023-07-17 13:11:02,041 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1b89fe16757ad0fa7999b813ad1f00a7, server=jenkins-hbase4.apache.org,32803,1689599458048}] 2023-07-17 13:11:02,112 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 13:11:02,213 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:11:02,213 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1b89fe16757ad0fa7999b813ad1f00a7, NAME => 'hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7.', STARTKEY => '', ENDKEY => ''} 2023-07-17 13:11:02,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. service=AccessControlService 2023-07-17 13:11:02,214 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:02,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 1b89fe16757ad0fa7999b813ad1f00a7 2023-07-17 13:11:02,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:02,214 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1b89fe16757ad0fa7999b813ad1f00a7 2023-07-17 13:11:02,215 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1b89fe16757ad0fa7999b813ad1f00a7 2023-07-17 13:11:02,221 INFO [StoreOpener-1b89fe16757ad0fa7999b813ad1f00a7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 1b89fe16757ad0fa7999b813ad1f00a7 2023-07-17 13:11:02,224 DEBUG [StoreOpener-1b89fe16757ad0fa7999b813ad1f00a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7/l 2023-07-17 13:11:02,224 DEBUG [StoreOpener-1b89fe16757ad0fa7999b813ad1f00a7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7/l 2023-07-17 13:11:02,225 INFO [StoreOpener-1b89fe16757ad0fa7999b813ad1f00a7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1b89fe16757ad0fa7999b813ad1f00a7 columnFamilyName l 2023-07-17 13:11:02,226 INFO [StoreOpener-1b89fe16757ad0fa7999b813ad1f00a7-1] regionserver.HStore(310): Store=1b89fe16757ad0fa7999b813ad1f00a7/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:02,229 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7 2023-07-17 13:11:02,231 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7 2023-07-17 13:11:02,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1b89fe16757ad0fa7999b813ad1f00a7 2023-07-17 13:11:02,243 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:02,245 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1b89fe16757ad0fa7999b813ad1f00a7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64667895, jitterRate=-0.03637327253818512}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:02,245 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1b89fe16757ad0fa7999b813ad1f00a7: 2023-07-17 13:11:02,247 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7., pid=11, masterSystemTime=1689599462199 2023-07-17 13:11:02,250 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:11:02,250 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:11:02,252 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1b89fe16757ad0fa7999b813ad1f00a7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:02,253 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1689599462252"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599462252"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599462252"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599462252"}]},"ts":"1689599462252"} 2023-07-17 13:11:02,267 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-17 13:11:02,268 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1b89fe16757ad0fa7999b813ad1f00a7, server=jenkins-hbase4.apache.org,32803,1689599458048 in 215 msec 2023-07-17 13:11:02,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-17 13:11:02,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=1b89fe16757ad0fa7999b813ad1f00a7, ASSIGN in 387 msec 2023-07-17 13:11:02,275 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:11:02,275 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599462275"}]},"ts":"1689599462275"} 2023-07-17 13:11:02,278 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-17 13:11:02,281 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:11:02,284 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 495 msec 2023-07-17 13:11:02,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-17 13:11:02,447 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-17 13:11:02,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-17 13:11:03,548 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:11:03,953 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:11:03,960 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44007_jobhistory____jwwgio/webapp 2023-07-17 13:11:04,168 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-17 13:11:04,169 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-17 13:11:04,169 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 13:11:04,174 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 13:11:04,285 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:04,645 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:05,041 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-17 13:11:05,109 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44007 2023-07-17 13:11:06,271 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:11:06,508 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-17 13:11:06,509 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-17 13:11:06,510 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-17 13:11:06,536 WARN [Listener at jenkins-hbase4.apache.org/38957] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:11:06,639 WARN [Listener at jenkins-hbase4.apache.org/38957] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 13:11:06,640 INFO [Listener at jenkins-hbase4.apache.org/38957] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:11:06,648 INFO [Listener at jenkins-hbase4.apache.org/38957] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44965_cluster____.r47w5w/webapp 2023-07-17 13:11:06,669 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:06,669 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-17 13:11:06,670 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:06,670 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-17 13:11:06,670 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 13:11:06,670 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-17 13:11:06,670 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:06,670 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-17 13:11:06,670 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 13:11:06,670 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-17 13:11:06,747 INFO [Listener at jenkins-hbase4.apache.org/38957] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 13:11:06,747 INFO [Listener at jenkins-hbase4.apache.org/38957] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-17 13:11:06,747 INFO [Listener at jenkins-hbase4.apache.org/38957] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 13:11:06,752 INFO [Listener at jenkins-hbase4.apache.org/38957] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 13:11:06,767 INFO [Listener at jenkins-hbase4.apache.org/38957] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:06,970 INFO [Listener at jenkins-hbase4.apache.org/38957] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:07,093 INFO [Listener at jenkins-hbase4.apache.org/38957] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:07,108 INFO [Listener at jenkins-hbase4.apache.org/38957] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44965 2023-07-17 13:11:07,756 WARN [Listener at jenkins-hbase4.apache.org/42409] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:11:07,789 WARN [Listener at jenkins-hbase4.apache.org/42409] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 13:11:07,790 INFO [Listener at jenkins-hbase4.apache.org/42409] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:11:07,799 INFO [Listener at jenkins-hbase4.apache.org/42409] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_46563_node____ezaypa/webapp 2023-07-17 13:11:07,855 INFO [Listener at jenkins-hbase4.apache.org/42409] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 13:11:07,855 INFO [Listener at jenkins-hbase4.apache.org/42409] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 13:11:07,855 INFO [Listener at jenkins-hbase4.apache.org/42409] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 13:11:07,855 INFO [Listener at jenkins-hbase4.apache.org/42409] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 13:11:07,865 INFO [Listener at jenkins-hbase4.apache.org/42409] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:07,888 INFO [Listener at jenkins-hbase4.apache.org/42409] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:07,984 INFO [Listener at jenkins-hbase4.apache.org/42409] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:07,999 INFO [Listener at jenkins-hbase4.apache.org/42409] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:46563 2023-07-17 13:11:08,376 WARN [Listener at jenkins-hbase4.apache.org/45655] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-17 13:11:08,384 WARN [Listener at jenkins-hbase4.apache.org/45655] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-17 13:11:08,384 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): jetty-6.1.26 2023-07-17 13:11:08,394 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_42043_node____jgyjlb/webapp 2023-07-17 13:11:08,459 INFO [Listener at jenkins-hbase4.apache.org/45655] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-17 13:11:08,460 INFO [Listener at jenkins-hbase4.apache.org/45655] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-17 13:11:08,460 INFO [Listener at jenkins-hbase4.apache.org/45655] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-17 13:11:08,460 INFO [Listener at jenkins-hbase4.apache.org/45655] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-17 13:11:08,472 INFO [Listener at jenkins-hbase4.apache.org/45655] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:08,494 INFO [Listener at jenkins-hbase4.apache.org/45655] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:08,594 INFO [Listener at jenkins-hbase4.apache.org/45655] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-17 13:11:08,604 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:42043 2023-07-17 13:11:08,649 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-17 13:11:08,651 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:08,727 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=389, ProcessCount=174, AvailableMemoryMB=5037 2023-07-17 13:11:08,728 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-17 13:11:08,747 DEBUG [Listener at jenkins-hbase4.apache.org/45655] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-17 13:11:08,753 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-17 13:11:08,761 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 13:11:08,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:08,767 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:11:08,768 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-17 13:11:08,769 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 13:11:08,770 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:11:08,778 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:08,778 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:08,781 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489 empty. 2023-07-17 13:11:08,781 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd empty. 2023-07-17 13:11:08,782 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:08,782 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:08,783 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 13:11:08,835 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:08,837 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2710364de496b6d8c6b6ad28fbf188cd, NAME => 'testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:11:08,839 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 27061dad036a5cb7031d7f22655e9489, NAME => 'testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:11:08,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 13:11:08,916 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:08,917 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 2710364de496b6d8c6b6ad28fbf188cd, disabling compactions & flushes 2023-07-17 13:11:08,917 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:08,917 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:08,917 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. after waiting 0 ms 2023-07-17 13:11:08,917 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:08,917 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:08,917 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 2710364de496b6d8c6b6ad28fbf188cd: 2023-07-17 13:11:08,927 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:08,927 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 27061dad036a5cb7031d7f22655e9489, disabling compactions & flushes 2023-07-17 13:11:08,927 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:08,927 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:08,927 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. after waiting 0 ms 2023-07-17 13:11:08,927 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:08,927 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:08,928 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 27061dad036a5cb7031d7f22655e9489: 2023-07-17 13:11:08,935 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:11:08,936 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599468936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599468936"}]},"ts":"1689599468936"} 2023-07-17 13:11:08,937 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599468936"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599468936"}]},"ts":"1689599468936"} 2023-07-17 13:11:08,996 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:11:08,998 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:11:08,998 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599468998"}]},"ts":"1689599468998"} 2023-07-17 13:11:09,001 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-17 13:11:09,006 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:09,008 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:09,008 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:09,008 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:09,008 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:09,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2710364de496b6d8c6b6ad28fbf188cd, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=27061dad036a5cb7031d7f22655e9489, ASSIGN}] 2023-07-17 13:11:09,011 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2710364de496b6d8c6b6ad28fbf188cd, ASSIGN 2023-07-17 13:11:09,011 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=27061dad036a5cb7031d7f22655e9489, ASSIGN 2023-07-17 13:11:09,013 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=27061dad036a5cb7031d7f22655e9489, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37517,1689599458122; forceNewPlan=false, retain=false 2023-07-17 13:11:09,013 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2710364de496b6d8c6b6ad28fbf188cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32803,1689599458048; forceNewPlan=false, retain=false 2023-07-17 13:11:09,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 13:11:09,163 INFO [jenkins-hbase4:42365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:11:09,165 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=27061dad036a5cb7031d7f22655e9489, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:09,165 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2710364de496b6d8c6b6ad28fbf188cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:09,165 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599469165"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599469165"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599469165"}]},"ts":"1689599469165"} 2023-07-17 13:11:09,165 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599469165"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599469165"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599469165"}]},"ts":"1689599469165"} 2023-07-17 13:11:09,168 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure 27061dad036a5cb7031d7f22655e9489, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:11:09,169 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 2710364de496b6d8c6b6ad28fbf188cd, server=jenkins-hbase4.apache.org,32803,1689599458048}] 2023-07-17 13:11:09,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:09,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:09,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27061dad036a5cb7031d7f22655e9489, NAME => 'testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:11:09,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2710364de496b6d8c6b6ad28fbf188cd, NAME => 'testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:11:09,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. service=AccessControlService 2023-07-17 13:11:09,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. service=AccessControlService 2023-07-17 13:11:09,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:09,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:09,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:09,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:09,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:09,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:09,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:09,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:09,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:09,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:09,331 INFO [StoreOpener-27061dad036a5cb7031d7f22655e9489-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:09,331 INFO [StoreOpener-2710364de496b6d8c6b6ad28fbf188cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:09,333 DEBUG [StoreOpener-27061dad036a5cb7031d7f22655e9489-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/cf 2023-07-17 13:11:09,333 DEBUG [StoreOpener-27061dad036a5cb7031d7f22655e9489-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/cf 2023-07-17 13:11:09,333 DEBUG [StoreOpener-2710364de496b6d8c6b6ad28fbf188cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/cf 2023-07-17 13:11:09,333 DEBUG [StoreOpener-2710364de496b6d8c6b6ad28fbf188cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/cf 2023-07-17 13:11:09,337 INFO [StoreOpener-2710364de496b6d8c6b6ad28fbf188cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2710364de496b6d8c6b6ad28fbf188cd columnFamilyName cf 2023-07-17 13:11:09,337 INFO [StoreOpener-27061dad036a5cb7031d7f22655e9489-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27061dad036a5cb7031d7f22655e9489 columnFamilyName cf 2023-07-17 13:11:09,340 INFO [StoreOpener-27061dad036a5cb7031d7f22655e9489-1] regionserver.HStore(310): Store=27061dad036a5cb7031d7f22655e9489/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:09,340 INFO [StoreOpener-2710364de496b6d8c6b6ad28fbf188cd-1] regionserver.HStore(310): Store=2710364de496b6d8c6b6ad28fbf188cd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:09,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:09,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:09,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:09,344 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:09,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:09,349 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:09,354 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:09,355 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:09,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2710364de496b6d8c6b6ad28fbf188cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74100468, jitterRate=0.10418301820755005}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2710364de496b6d8c6b6ad28fbf188cd: 2023-07-17 13:11:09,356 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27061dad036a5cb7031d7f22655e9489; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64584341, jitterRate=-0.03761832416057587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:09,356 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27061dad036a5cb7031d7f22655e9489: 2023-07-17 13:11:09,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489., pid=15, masterSystemTime=1689599469320 2023-07-17 13:11:09,358 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd., pid=16, masterSystemTime=1689599469322 2023-07-17 13:11:09,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:09,362 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:09,363 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=27061dad036a5cb7031d7f22655e9489, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:09,363 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599469362"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599469362"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599469362"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599469362"}]},"ts":"1689599469362"} 2023-07-17 13:11:09,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:09,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:09,366 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=2710364de496b6d8c6b6ad28fbf188cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:09,370 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599469366"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599469366"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599469366"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599469366"}]},"ts":"1689599469366"} 2023-07-17 13:11:09,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-17 13:11:09,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure 27061dad036a5cb7031d7f22655e9489, server=jenkins-hbase4.apache.org,37517,1689599458122 in 204 msec 2023-07-17 13:11:09,381 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-17 13:11:09,382 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=27061dad036a5cb7031d7f22655e9489, ASSIGN in 371 msec 2023-07-17 13:11:09,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 2710364de496b6d8c6b6ad28fbf188cd, server=jenkins-hbase4.apache.org,32803,1689599458048 in 206 msec 2023-07-17 13:11:09,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-17 13:11:09,386 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2710364de496b6d8c6b6ad28fbf188cd, ASSIGN in 375 msec 2023-07-17 13:11:09,387 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:11:09,387 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599469387"}]},"ts":"1689599469387"} 2023-07-17 13:11:09,389 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-17 13:11:09,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 13:11:09,392 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:11:09,398 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-17 13:11:09,410 DEBUG [hconnection-0x1f61e0d7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:09,414 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38274, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2023-07-17 13:11:09,422 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 13:11:09,456 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:09,456 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:09,456 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:09,456 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:09,456 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:11:09,466 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:09,472 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:09,472 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:09,478 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 714 msec 2023-07-17 13:11:09,482 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:09,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-17 13:11:09,893 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-17 13:11:09,897 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-17 13:11:09,898 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:09,901 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:09,924 DEBUG [hconnection-0x346953fe-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:09,927 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:09,944 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:09,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599469944 (current time:1689599469944). 2023-07-17 13:11:09,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:09,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x6eefac2e to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:09,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5e000787, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:09,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:09,956 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:09,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6eefac2e to 127.0.0.1:62970 2023-07-17 13:11:09,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:09,959 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x50a4b995 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:09,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54f9cc2b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:09,967 DEBUG [hconnection-0x16355212-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:09,968 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38292, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:09,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:09,974 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:09,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50a4b995 to 127.0.0.1:62970 2023-07-17 13:11:09,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:09,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 13:11:10,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:10,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:10,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,037 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,039 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689600070039 2023-07-17 13:11:10,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:10,039 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 13:11:10,043 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,047 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:10,048 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 18 msec 2023-07-17 13:11:10,049 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:10,051 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689600070051 2023-07-17 13:11:10,051 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:10,052 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:10,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,083 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-17 13:11:10,083 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,084 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 13:11:10,084 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 13:11:10,085 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,085 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,092 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,092 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,092 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,093 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,093 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,095 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,095 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,095 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 13:11:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 13:11:10,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,096 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,096 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,096 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,098 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:10,098 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-17 13:11:10,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,099 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,101 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,101 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,101 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,101 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,101 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,101 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,101 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,101 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,103 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,103 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,101 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,104 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,104 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,104 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,104 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,103 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,105 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,105 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,107 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,107 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,107 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,108 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,108 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,108 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,109 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,108 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,111 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,111 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,112 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 13:11:10,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f5535c0[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,109 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-17 13:11:10,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f5535c0[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:10,116 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 13:11:10,116 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,119 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,119 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,119 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,119 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,119 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,120 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,120 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:10,120 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,120 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:11:10,120 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,120 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,120 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:10,121 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:10,121 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:10,121 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:10,121 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:10,121 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:10,121 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:10,121 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. started... 2023-07-17 13:11:10,121 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. started... 2023-07-17 13:11:10,125 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2710364de496b6d8c6b6ad28fbf188cd: 2023-07-17 13:11:10,125 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 27061dad036a5cb7031d7f22655e9489: 2023-07-17 13:11:10,126 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,126 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,129 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:10,129 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:10,129 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:10,135 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:10,135 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:10,138 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:10,138 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:10,152 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:10,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:10,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:10,157 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:10,205 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. completed. 2023-07-17 13:11:10,205 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:10,206 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:10,206 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:10,206 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,206 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:10,206 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:11:10,214 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:10,215 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:10,216 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,217 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. completed. 2023-07-17 13:11:10,217 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:10,217 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,217 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:10,218 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:11:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,220 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:10,220 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,220 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:10,220 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:11:10,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 13:11:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,32803,1689599458048': 2023-07-17 13:11:10,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 13:11:10,230 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-17 13:11:10,230 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:10,230 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:10,230 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,230 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:10,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,234 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,234 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,235 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,236 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,238 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,248 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,249 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,249 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,266 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:10,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,267 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,268 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,268 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,268 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:10,268 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-17 13:11:10,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,269 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:11:10,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,268 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,270 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:10,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:10,271 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 13:11:10,297 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,357 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:10,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:10,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:10,359 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:11:10,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,419 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 13:11:10,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,420 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:10,420 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689599470039Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689599470297 (+258 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1689599470297Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1689599470297Writing data manifest for emptySnaptb0-testExportWithTargetName at 1689599470324 (+27 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1689599470357 (+33 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689599470419 (+62 ms) 2023-07-17 13:11:10,423 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:10,425 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 382 msec 2023-07-17 13:11:10,659 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:10,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:10,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:10,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32803] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:10,680 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37517] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:10,684 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-17 13:11:10,684 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:10,685 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:10,700 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:10,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599470700 (current time:1689599470700). 2023-07-17 13:11:10,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:10,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x1cd50d2b to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:10,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@448f2057, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:10,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:10,711 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:10,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cd50d2b to 127.0.0.1:62970 2023-07-17 13:11:10,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:10,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x02fdda1f to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:10,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36f5233e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:10,721 DEBUG [hconnection-0xb45302f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:10,724 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:10,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:10,731 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:10,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02fdda1f to 127.0.0.1:62970 2023-07-17 13:11:10,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:10,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-17 13:11:10,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:10,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:10,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,738 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,739 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1689600070739 2023-07-17 13:11:10,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-17 13:11:10,739 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-17 13:11:10,741 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:10,741 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:10,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:10,742 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-17 13:11:10,744 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-17 13:11:10,745 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:10,746 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1689600070746 2023-07-17 13:11:10,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-17 13:11:10,765 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-17 13:11:10,765 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,767 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-17 13:11:10,767 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-17 13:11:10,767 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,767 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,769 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,769 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,769 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,769 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:10,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,769 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:10,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,769 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:10,770 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 13:11:10,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,771 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 13:11:10,771 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,771 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,772 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,773 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,773 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:10,772 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,773 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,773 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,776 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 13:11:10,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-17 13:11:10,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,776 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,776 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-17 13:11:10,776 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,776 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 13:11:10,776 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,776 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-17 13:11:10,777 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,777 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-17 13:11:10,777 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,777 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,777 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:10,778 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-17 13:11:10,778 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-17 13:11:10,778 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-17 13:11:10,780 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,780 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,780 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,780 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,781 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,781 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,781 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,781 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:10,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:10,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 13:11:10,784 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f428b[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:10,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:10,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:10,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:10,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:10,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:10,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:10,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:10,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-17 13:11:10,787 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f428b[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:10,787 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-17 13:11:10,787 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,792 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,792 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,792 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,792 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:10,792 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:10,793 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:10,793 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,793 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. started... 2023-07-17 13:11:10,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,793 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,793 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:10,793 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2710364de496b6d8c6b6ad28fbf188cd 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 13:11:10,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,793 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:10,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,793 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:10,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:10,793 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,793 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-17 13:11:10,793 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:10,793 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:11:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:10,794 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:10,794 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:10,794 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. started... 2023-07-17 13:11:10,794 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 27061dad036a5cb7031d7f22655e9489 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 13:11:10,797 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:10,797 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:10,797 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:10,841 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:10,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:10,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:10,843 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:10,976 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307172019f5d075914ecbabcda4b359755784 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307172019f5d075914ecbabcda4b359755784 2023-07-17 13:11:10,976 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717fdd15d37dccd4da586ee8bb8c1bc3be1 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230717fdd15d37dccd4da586ee8bb8c1bc3be1 2023-07-17 13:11:11,026 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/.tmp/cf/038439bafee5492bab0189858f4044a3 2023-07-17 13:11:11,027 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/.tmp/cf/dd71b01dde5d46fe83aa6c2d6cd23835 2023-07-17 13:11:11,043 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/.tmp/cf/038439bafee5492bab0189858f4044a3 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/cf/038439bafee5492bab0189858f4044a3 2023-07-17 13:11:11,043 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:11,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:11,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:11,046 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/.tmp/cf/dd71b01dde5d46fe83aa6c2d6cd23835 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/cf/dd71b01dde5d46fe83aa6c2d6cd23835 2023-07-17 13:11:11,046 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:11:11,058 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/cf/dd71b01dde5d46fe83aa6c2d6cd23835, entries=3, sequenceid=6, filesize=5.4 K 2023-07-17 13:11:11,063 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 2710364de496b6d8c6b6ad28fbf188cd in 270ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:11,063 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-17 13:11:11,064 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2710364de496b6d8c6b6ad28fbf188cd: 2023-07-17 13:11:11,065 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 13:11:11,065 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/cf/038439bafee5492bab0189858f4044a3, entries=47, sequenceid=6, filesize=12.8 K 2023-07-17 13:11:11,065 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:11,067 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/cf/dd71b01dde5d46fe83aa6c2d6cd23835] hfiles 2023-07-17 13:11:11,067 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/cf/dd71b01dde5d46fe83aa6c2d6cd23835 for snapshot=snaptb0-testExportWithTargetName 2023-07-17 13:11:11,069 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 27061dad036a5cb7031d7f22655e9489 in 275ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:11,070 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 27061dad036a5cb7031d7f22655e9489: 2023-07-17 13:11:11,071 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 13:11:11,071 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:11,071 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/cf/038439bafee5492bab0189858f4044a3] hfiles 2023-07-17 13:11:11,071 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/cf/038439bafee5492bab0189858f4044a3 for snapshot=snaptb0-testExportWithTargetName 2023-07-17 13:11:11,108 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. completed. 2023-07-17 13:11:11,109 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:11,109 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:11,109 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:11,109 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,109 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:11,109 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:11:11,113 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:11,113 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,113 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:11,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,113 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:11,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:11,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:11,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,117 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. completed. 2023-07-17 13:11:11,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:11,117 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:11,118 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:11,118 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:11,118 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,118 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-17 13:11:11,118 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:11:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:11,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,120 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-17 13:11:11,120 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,120 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:11,120 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-17 13:11:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:11:11,123 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-17 13:11:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:11,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:11,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:11,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,32803,1689599458048': 2023-07-17 13:11:11,130 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-17 13:11:11,130 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-17 13:11:11,130 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:11,130 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:11,130 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-17 13:11:11,130 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:11,133 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,133 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:11,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:11,133 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,133 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,133 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,134 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,134 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:11,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,134 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,134 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,135 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:11,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:11,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,143 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:11,144 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:11,144 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:11,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-17 13:11:11,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:11,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:11,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:11,161 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,161 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-17 13:11:11,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,162 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,162 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,162 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,162 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-17 13:11:11,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-17 13:11:11,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:11:11,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:11,161 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:11,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:11,161 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:11,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,162 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:11,163 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,163 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:11,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,163 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:11,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:11,163 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:11,164 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,164 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307172019f5d075914ecbabcda4b359755784, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230717fdd15d37dccd4da586ee8bb8c1bc3be1] mob files 2023-07-17 13:11:11,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307172019f5d075914ecbabcda4b359755784 2023-07-17 13:11:11,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230717fdd15d37dccd4da586ee8bb8c1bc3be1 2023-07-17 13:11:11,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-17 13:11:11,182 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,227 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,273 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-17 13:11:11,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,274 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-17 13:11:11,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1689599470739Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1689599471181 (+442 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1689599471181Loading Region manifests for snaptb0-testExportWithTargetName at 1689599471181Writing data manifest for snaptb0-testExportWithTargetName at 1689599471193 (+12 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1689599471215 (+22 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1689599471273 (+58 ms) 2023-07-17 13:11:11,276 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-17 13:11:11,280 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 537 msec 2023-07-17 13:11:11,347 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:11,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-17 13:11:11,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:11,350 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599471350 2023-07-17 13:11:11,351 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42441, tgtDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599471350, rawTgtDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599471350, srcFsUri=hdfs://localhost:42441, srcDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:11:11,388 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:11:11,388 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_819311211_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599471350, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599471350/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 13:11:11,388 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295, snapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-17 13:11:11,408 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599471350/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-17 13:11:11,491 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:11,491 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:11,492 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:11,492 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,489 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-5291629379313238107.jar 2023-07-17 13:11:12,489 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,490 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,562 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-5337511422701068690.jar 2023-07-17 13:11:12,562 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,563 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,564 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,564 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,564 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,565 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:12,566 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:11:12,566 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:11:12,567 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:11:12,568 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:11:12,568 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:11:12,569 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:11:12,570 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:11:12,570 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:11:12,571 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:11:12,571 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:11:12,575 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:12,576 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:12,576 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:12,576 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:12,577 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:12,577 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:12,578 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:14,213 WARN [Listener at jenkins-hbase4.apache.org/45655] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:11:14,220 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-17 13:11:14,231 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-17 13:11:14,759 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:14,761 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:14,844 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:11:15,336 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0001_000001 (auth:SIMPLE) 2023-07-17 13:11:20,762 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0001_000001 (auth:SIMPLE) 2023-07-17 13:11:23,035 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0001_000001 (auth:SIMPLE) 2023-07-17 13:11:26,681 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0001_000001 (auth:SIMPLE) 2023-07-17 13:11:28,288 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:11:28,291 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:11:28,306 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-17 13:11:28,306 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:11:28,307 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:11:28,307 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-17 13:11:28,308 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-17 13:11:28,308 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-17 13:11:28,308 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599471350/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599471350/.hbase-snapshot/testExportWithTargetName 2023-07-17 13:11:28,308 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599471350/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-17 13:11:28,309 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599471350/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-17 13:11:28,320 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-17 13:11:28,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-17 13:11:28,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:28,339 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599488339"}]},"ts":"1689599488339"} 2023-07-17 13:11:28,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 13:11:28,341 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-17 13:11:28,343 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-17 13:11:28,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2710364de496b6d8c6b6ad28fbf188cd, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=27061dad036a5cb7031d7f22655e9489, UNASSIGN}] 2023-07-17 13:11:28,348 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2710364de496b6d8c6b6ad28fbf188cd, UNASSIGN 2023-07-17 13:11:28,348 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=27061dad036a5cb7031d7f22655e9489, UNASSIGN 2023-07-17 13:11:28,349 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=2710364de496b6d8c6b6ad28fbf188cd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:28,349 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=27061dad036a5cb7031d7f22655e9489, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:28,349 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599488349"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599488349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599488349"}]},"ts":"1689599488349"} 2023-07-17 13:11:28,349 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599488349"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599488349"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599488349"}]},"ts":"1689599488349"} 2023-07-17 13:11:28,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 2710364de496b6d8c6b6ad28fbf188cd, server=jenkins-hbase4.apache.org,32803,1689599458048}] 2023-07-17 13:11:28,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 27061dad036a5cb7031d7f22655e9489, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:11:28,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 13:11:28,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:28,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:28,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27061dad036a5cb7031d7f22655e9489, disabling compactions & flushes 2023-07-17 13:11:28,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2710364de496b6d8c6b6ad28fbf188cd, disabling compactions & flushes 2023-07-17 13:11:28,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:28,513 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:28,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:28,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:28,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. after waiting 0 ms 2023-07-17 13:11:28,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. after waiting 0 ms 2023-07-17 13:11:28,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:28,513 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:28,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:11:28,534 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:11:28,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:28,535 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:28,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489. 2023-07-17 13:11:28,537 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd. 2023-07-17 13:11:28,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27061dad036a5cb7031d7f22655e9489: 2023-07-17 13:11:28,537 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2710364de496b6d8c6b6ad28fbf188cd: 2023-07-17 13:11:28,542 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:28,543 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=27061dad036a5cb7031d7f22655e9489, regionState=CLOSED 2023-07-17 13:11:28,543 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:28,543 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599488543"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599488543"}]},"ts":"1689599488543"} 2023-07-17 13:11:28,546 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=2710364de496b6d8c6b6ad28fbf188cd, regionState=CLOSED 2023-07-17 13:11:28,546 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1689599488546"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599488546"}]},"ts":"1689599488546"} 2023-07-17 13:11:28,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-17 13:11:28,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 27061dad036a5cb7031d7f22655e9489, server=jenkins-hbase4.apache.org,37517,1689599458122 in 194 msec 2023-07-17 13:11:28,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-17 13:11:28,551 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 2710364de496b6d8c6b6ad28fbf188cd, server=jenkins-hbase4.apache.org,32803,1689599458048 in 197 msec 2023-07-17 13:11:28,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=27061dad036a5cb7031d7f22655e9489, UNASSIGN in 205 msec 2023-07-17 13:11:28,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=22, resume processing ppid=21 2023-07-17 13:11:28,554 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2710364de496b6d8c6b6ad28fbf188cd, UNASSIGN in 206 msec 2023-07-17 13:11:28,555 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599488554"}]},"ts":"1689599488554"} 2023-07-17 13:11:28,556 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-17 13:11:28,558 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-17 13:11:28,560 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 231 msec 2023-07-17 13:11:28,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-17 13:11:28,643 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-17 13:11:28,648 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-17 13:11:28,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:28,659 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:28,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-17 13:11:28,661 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:28,664 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-17 13:11:28,668 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:28,668 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:28,671 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 13:11:28,671 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 13:11:28,671 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 13:11:28,671 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 13:11:28,672 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/recovered.edits] 2023-07-17 13:11:28,673 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/recovered.edits] 2023-07-17 13:11:28,673 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-17 13:11:28,674 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:28,674 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-17 13:11:28,674 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:28,674 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:28,674 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:28,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 13:11:28,674 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:11:28,674 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 13:11:28,675 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:11:28,675 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-17 13:11:28,675 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:11:28,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 13:11:28,683 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/cf/038439bafee5492bab0189858f4044a3 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/cf/038439bafee5492bab0189858f4044a3 2023-07-17 13:11:28,683 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/cf/dd71b01dde5d46fe83aa6c2d6cd23835 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/cf/dd71b01dde5d46fe83aa6c2d6cd23835 2023-07-17 13:11:28,689 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd/recovered.edits/9.seqid 2023-07-17 13:11:28,689 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489/recovered.edits/9.seqid 2023-07-17 13:11:28,690 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/2710364de496b6d8c6b6ad28fbf188cd 2023-07-17 13:11:28,690 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportWithTargetName/27061dad036a5cb7031d7f22655e9489 2023-07-17 13:11:28,691 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-17 13:11:28,691 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-17 13:11:28,693 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-17 13:11:28,699 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307172019f5d075914ecbabcda4b359755784 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307172019f5d075914ecbabcda4b359755784 2023-07-17 13:11:28,701 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230717fdd15d37dccd4da586ee8bb8c1bc3be1 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230717fdd15d37dccd4da586ee8bb8c1bc3be1 2023-07-17 13:11:28,701 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-17 13:11:28,706 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:28,733 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-17 13:11:28,737 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-17 13:11:28,739 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:28,739 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-17 13:11:28,739 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599488739"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:28,740 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599488739"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:28,742 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:11:28,743 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2710364de496b6d8c6b6ad28fbf188cd, NAME => 'testtb-testExportWithTargetName,,1689599468761.2710364de496b6d8c6b6ad28fbf188cd.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 27061dad036a5cb7031d7f22655e9489, NAME => 'testtb-testExportWithTargetName,1,1689599468761.27061dad036a5cb7031d7f22655e9489.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:11:28,743 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-17 13:11:28,743 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599488743"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:28,746 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-17 13:11:28,751 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-17 13:11:28,753 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 102 msec 2023-07-17 13:11:28,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-17 13:11:28,781 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-17 13:11:28,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-17 13:11:28,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-17 13:11:28,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-17 13:11:28,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-17 13:11:28,835 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 706) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2102564128_1 at /127.0.0.1:50520 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:45536 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (119954474) connection to jenkins-hbase4.apache.org/172.31.14.131:39469 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (119954474) connection to jenkins-hbase4.apache.org/172.31.14.131:43243 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1318 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:37876 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:50540 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_2102564128_1 at /127.0.0.1:45498 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=430 (was 389) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 174) - ProcessCount LEAK? -, AvailableMemoryMB=3384 (was 5037) 2023-07-17 13:11:28,836 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-17 13:11:28,855 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=430, ProcessCount=181, AvailableMemoryMB=3383 2023-07-17 13:11:28,856 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-17 13:11:28,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 13:11:28,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:28,862 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:11:28,863 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-17 13:11:28,864 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:11:28,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 13:11:28,867 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:28,867 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:28,868 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e empty. 2023-07-17 13:11:28,868 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b empty. 2023-07-17 13:11:28,869 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:28,869 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:28,869 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 13:11:28,882 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:28,883 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7696948d1fbcc3d715f0e21a300ea19e, NAME => 'testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:11:28,884 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2648189d324d898a0b0028f3d2b6352b, NAME => 'testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:11:28,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:28,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:28,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 2648189d324d898a0b0028f3d2b6352b, disabling compactions & flushes 2023-07-17 13:11:28,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 7696948d1fbcc3d715f0e21a300ea19e, disabling compactions & flushes 2023-07-17 13:11:28,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:28,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:28,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:28,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:28,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. after waiting 0 ms 2023-07-17 13:11:28,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. after waiting 0 ms 2023-07-17 13:11:28,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:28,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:28,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:28,922 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:28,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 7696948d1fbcc3d715f0e21a300ea19e: 2023-07-17 13:11:28,922 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 2648189d324d898a0b0028f3d2b6352b: 2023-07-17 13:11:28,925 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:11:28,926 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599488926"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599488926"}]},"ts":"1689599488926"} 2023-07-17 13:11:28,926 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599488926"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599488926"}]},"ts":"1689599488926"} 2023-07-17 13:11:28,929 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:11:28,930 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:11:28,930 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599488930"}]},"ts":"1689599488930"} 2023-07-17 13:11:28,932 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 13:11:28,936 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:28,937 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:28,937 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:28,937 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:28,937 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:28,938 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7696948d1fbcc3d715f0e21a300ea19e, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2648189d324d898a0b0028f3d2b6352b, ASSIGN}] 2023-07-17 13:11:28,940 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2648189d324d898a0b0028f3d2b6352b, ASSIGN 2023-07-17 13:11:28,940 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7696948d1fbcc3d715f0e21a300ea19e, ASSIGN 2023-07-17 13:11:28,941 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2648189d324d898a0b0028f3d2b6352b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39513,1689599458171; forceNewPlan=false, retain=false 2023-07-17 13:11:28,942 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7696948d1fbcc3d715f0e21a300ea19e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37517,1689599458122; forceNewPlan=false, retain=false 2023-07-17 13:11:28,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 13:11:29,092 INFO [jenkins-hbase4:42365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:11:29,094 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7696948d1fbcc3d715f0e21a300ea19e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,094 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2648189d324d898a0b0028f3d2b6352b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,094 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599489094"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599489094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599489094"}]},"ts":"1689599489094"} 2023-07-17 13:11:29,095 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599489094"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599489094"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599489094"}]},"ts":"1689599489094"} 2023-07-17 13:11:29,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 7696948d1fbcc3d715f0e21a300ea19e, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:11:29,098 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure 2648189d324d898a0b0028f3d2b6352b, server=jenkins-hbase4.apache.org,39513,1689599458171}] 2023-07-17 13:11:29,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 13:11:29,251 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,252 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:11:29,256 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:11:29,256 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:29,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7696948d1fbcc3d715f0e21a300ea19e, NAME => 'testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:11:29,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. service=AccessControlService 2023-07-17 13:11:29,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:29,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:29,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:29,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:29,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:29,262 INFO [StoreOpener-7696948d1fbcc3d715f0e21a300ea19e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:29,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:29,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2648189d324d898a0b0028f3d2b6352b, NAME => 'testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:11:29,263 DEBUG [StoreOpener-7696948d1fbcc3d715f0e21a300ea19e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/cf 2023-07-17 13:11:29,263 DEBUG [StoreOpener-7696948d1fbcc3d715f0e21a300ea19e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/cf 2023-07-17 13:11:29,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. service=AccessControlService 2023-07-17 13:11:29,264 INFO [StoreOpener-7696948d1fbcc3d715f0e21a300ea19e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7696948d1fbcc3d715f0e21a300ea19e columnFamilyName cf 2023-07-17 13:11:29,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:29,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:29,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:29,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:29,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:29,265 INFO [StoreOpener-7696948d1fbcc3d715f0e21a300ea19e-1] regionserver.HStore(310): Store=7696948d1fbcc3d715f0e21a300ea19e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:29,266 INFO [StoreOpener-2648189d324d898a0b0028f3d2b6352b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:29,268 DEBUG [StoreOpener-2648189d324d898a0b0028f3d2b6352b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/cf 2023-07-17 13:11:29,268 DEBUG [StoreOpener-2648189d324d898a0b0028f3d2b6352b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/cf 2023-07-17 13:11:29,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:29,268 INFO [StoreOpener-2648189d324d898a0b0028f3d2b6352b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2648189d324d898a0b0028f3d2b6352b columnFamilyName cf 2023-07-17 13:11:29,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:29,270 INFO [StoreOpener-2648189d324d898a0b0028f3d2b6352b-1] regionserver.HStore(310): Store=2648189d324d898a0b0028f3d2b6352b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:29,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:29,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:29,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:29,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:29,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:29,275 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7696948d1fbcc3d715f0e21a300ea19e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69986047, jitterRate=0.04287336766719818}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:29,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7696948d1fbcc3d715f0e21a300ea19e: 2023-07-17 13:11:29,276 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e., pid=30, masterSystemTime=1689599489249 2023-07-17 13:11:29,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:29,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2648189d324d898a0b0028f3d2b6352b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66621717, jitterRate=-0.007259055972099304}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:29,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2648189d324d898a0b0028f3d2b6352b: 2023-07-17 13:11:29,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b., pid=31, masterSystemTime=1689599489251 2023-07-17 13:11:29,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:29,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:29,284 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=7696948d1fbcc3d715f0e21a300ea19e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,284 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599489284"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599489284"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599489284"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599489284"}]},"ts":"1689599489284"} 2023-07-17 13:11:29,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:29,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:29,289 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=2648189d324d898a0b0028f3d2b6352b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,292 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599489289"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599489289"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599489289"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599489289"}]},"ts":"1689599489289"} 2023-07-17 13:11:29,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-17 13:11:29,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 7696948d1fbcc3d715f0e21a300ea19e, server=jenkins-hbase4.apache.org,37517,1689599458122 in 190 msec 2023-07-17 13:11:29,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7696948d1fbcc3d715f0e21a300ea19e, ASSIGN in 357 msec 2023-07-17 13:11:29,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-17 13:11:29,298 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure 2648189d324d898a0b0028f3d2b6352b, server=jenkins-hbase4.apache.org,39513,1689599458171 in 196 msec 2023-07-17 13:11:29,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=29, resume processing ppid=27 2023-07-17 13:11:29,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2648189d324d898a0b0028f3d2b6352b, ASSIGN in 360 msec 2023-07-17 13:11:29,301 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:11:29,301 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599489301"}]},"ts":"1689599489301"} 2023-07-17 13:11:29,303 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 13:11:29,306 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:11:29,306 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-17 13:11:29,309 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:11:29,311 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:29,311 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:29,311 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:29,311 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:29,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:29,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:29,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:29,313 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:29,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 454 msec 2023-07-17 13:11:29,468 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-17 13:11:29,468 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-17 13:11:29,472 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-17 13:11:29,472 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:29,475 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:29,499 DEBUG [hconnection-0x346953fe-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:29,519 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:29,525 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:29,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599489525 (current time:1689599489525). 2023-07-17 13:11:29,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:29,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x432d7ac0 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:29,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58d39676, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:29,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:29,543 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50970, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:29,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x432d7ac0 to 127.0.0.1:62970 2023-07-17 13:11:29,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:29,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x2f80945b to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:29,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7d30011, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:29,558 DEBUG [hconnection-0x437746bb-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:29,562 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50976, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:29,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:29,572 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:29,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2f80945b to 127.0.0.1:62970 2023-07-17 13:11:29,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:29,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:11:29,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:29,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:29,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:29,581 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:29,582 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689600089582 2023-07-17 13:11:29,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:29,583 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 13:11:29,586 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:29,586 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:29,587 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:29,588 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:29,592 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-17 13:11:29,593 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:29,594 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689600089594 2023-07-17 13:11:29,617 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,617 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-17 13:11:29,618 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:29,619 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 13:11:29,619 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 13:11:29,620 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,620 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,621 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,621 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,621 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,621 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,621 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,622 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,622 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,622 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,623 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 13:11:29,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 13:11:29,623 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-17 13:11:29,623 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:29,623 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:29,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:29,624 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:29,624 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,624 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:29,624 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:29,626 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,628 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,628 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:29,628 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:29,628 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:29,628 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:29,630 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:29,630 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:29,628 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:29,631 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:29,630 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:29,631 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:29,631 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:29,631 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:29,631 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,636 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,636 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,637 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:29,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,636 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,637 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:29,637 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,637 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:29,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 13:11:29,641 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c88bc04[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:29,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-17 13:11:29,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c88bc04[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:29,643 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 13:11:29,643 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,645 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,645 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,645 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,645 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,645 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:29,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:29,645 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:29,645 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,646 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. started... 2023-07-17 13:11:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:11:29,646 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:29,646 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:29,646 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:29,645 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:29,647 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. started... 2023-07-17 13:11:29,647 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2648189d324d898a0b0028f3d2b6352b: 2023-07-17 13:11:29,646 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:29,647 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7696948d1fbcc3d715f0e21a300ea19e: 2023-07-17 13:11:29,648 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,648 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,648 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:29,648 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:29,648 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:29,648 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:29,649 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:29,649 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,649 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:29,671 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. completed. 2023-07-17 13:11:29,671 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:29,671 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:29,671 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:29,671 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,672 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:29,672 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:11:29,675 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:29,675 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,675 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,675 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:29,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,678 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. completed. 2023-07-17 13:11:29,678 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:29,678 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:29,678 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:29,679 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,679 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:29,679 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:11:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,680 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:29,680 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,680 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,680 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:29,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39513,1689599458171': 2023-07-17 13:11:29,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 13:11:29,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,686 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:11:29,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:29,687 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:29,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:11:29,688 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 13:11:29,688 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-17 13:11:29,688 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:29,688 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:29,688 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,688 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:29,690 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,690 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:29,690 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,690 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,690 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,690 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,690 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:29,690 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:29,691 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,691 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,692 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,692 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,697 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:29,697 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,697 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,702 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,702 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,702 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,702 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,702 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:29,702 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,702 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:29,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:29,702 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,702 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,702 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:29,702 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:29,702 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-17 13:11:29,702 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:29,704 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:11:29,704 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:29,705 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,705 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:29,705 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,705 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:29,705 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:29,705 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,705 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,705 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 13:11:29,741 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,742 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,854 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 13:11:29,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,854 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:29,855 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689599489583Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689599489741 (+158 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1689599489741Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1689599489741Writing data manifest for emptySnaptb0-testExportFileSystemState at 1689599489755 (+14 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1689599489790 (+35 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689599489854 (+64 ms) 2023-07-17 13:11:29,857 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:29,859 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 272 msec 2023-07-17 13:11:29,887 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:29,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:11:29,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:29,893 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37517] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:29,895 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39513] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:29,900 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-17 13:11:29,900 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:29,901 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:29,918 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:29,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599489918 (current time:1689599489918). 2023-07-17 13:11:29,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:29,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x5f382370 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:29,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7b01be76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:29,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:29,973 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50992, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:29,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5f382370 to 127.0.0.1:62970 2023-07-17 13:11:29,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:29,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x06d5438c to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:29,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6eec2cf0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:29,996 DEBUG [hconnection-0x4f3b6f39-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:29,997 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51004, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:30,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:30,003 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:30,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06d5438c to 127.0.0.1:62970 2023-07-17 13:11:30,004 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:30,005 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:11:30,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:30,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:30,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:30,012 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:30,013 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689600090013 2023-07-17 13:11:30,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:11:30,013 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-17 13:11:30,015 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:30,015 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:30,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:30,016 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:11:30,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-17 13:11:30,019 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:30,020 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689600090020 2023-07-17 13:11:30,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-17 13:11:30,036 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-17 13:11:30,036 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:30,038 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-17 13:11:30,038 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-17 13:11:30,108 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,109 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,111 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:30,111 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:30,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:30,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:30,111 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,111 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:30,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,111 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,111 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,112 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,112 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:30,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,112 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 13:11:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 13:11:30,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:30,112 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-17 13:11:30,113 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 13:11:30,113 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 13:11:30,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,113 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:30,113 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-17 13:11:30,113 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:30,113 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:30,113 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-17 13:11:30,115 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:30,115 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-17 13:11:30,115 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:30,113 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:30,116 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:30,115 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:30,115 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:30,117 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-17 13:11:30,118 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-17 13:11:30,118 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-17 13:11:30,120 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,120 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:30,121 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:30,121 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:11:30,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:30,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:30,123 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:30,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 13:11:30,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f82204[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:30,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:30,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-17 13:11:30,126 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f82204[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:30,126 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 13:11:30,126 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,127 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,127 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,127 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,128 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:30,128 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:30,128 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:11:30,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,128 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:30,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,128 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:11:30,128 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:30,128 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:30,128 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:30,128 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:30,128 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. started... 2023-07-17 13:11:30,128 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,128 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:30,129 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. started... 2023-07-17 13:11:30,128 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:30,129 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 7696948d1fbcc3d715f0e21a300ea19e 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 13:11:30,129 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2648189d324d898a0b0028f3d2b6352b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 13:11:30,130 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:30,130 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,130 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:30,130 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:30,131 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:30,163 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307172c3cbec4950144d6ac7767da87ad1bf8 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307172c3cbec4950144d6ac7767da87ad1bf8 2023-07-17 13:11:30,163 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717f23f01718eef478bbe80a56e549096c6 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717f23f01718eef478bbe80a56e549096c6 2023-07-17 13:11:30,180 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/.tmp/cf/9ca6c6bf2ccb41c9be3179d8bc8cba03 2023-07-17 13:11:30,181 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/.tmp/cf/1fbf722686684a769e66884ee972eeac 2023-07-17 13:11:30,189 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/.tmp/cf/1fbf722686684a769e66884ee972eeac as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/cf/1fbf722686684a769e66884ee972eeac 2023-07-17 13:11:30,189 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/.tmp/cf/9ca6c6bf2ccb41c9be3179d8bc8cba03 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/cf/9ca6c6bf2ccb41c9be3179d8bc8cba03 2023-07-17 13:11:30,196 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/cf/1fbf722686684a769e66884ee972eeac, entries=3, sequenceid=6, filesize=5.4 K 2023-07-17 13:11:30,197 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 7696948d1fbcc3d715f0e21a300ea19e in 68ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:30,197 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-17 13:11:30,198 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7696948d1fbcc3d715f0e21a300ea19e: 2023-07-17 13:11:30,198 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 13:11:30,198 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:30,198 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/cf/1fbf722686684a769e66884ee972eeac] hfiles 2023-07-17 13:11:30,198 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/cf/1fbf722686684a769e66884ee972eeac for snapshot=snaptb0-testExportFileSystemState 2023-07-17 13:11:30,199 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/cf/9ca6c6bf2ccb41c9be3179d8bc8cba03, entries=47, sequenceid=6, filesize=12.8 K 2023-07-17 13:11:30,200 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 2648189d324d898a0b0028f3d2b6352b in 71ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:30,201 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2648189d324d898a0b0028f3d2b6352b: 2023-07-17 13:11:30,201 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 13:11:30,201 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:30,201 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/cf/9ca6c6bf2ccb41c9be3179d8bc8cba03] hfiles 2023-07-17 13:11:30,201 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/cf/9ca6c6bf2ccb41c9be3179d8bc8cba03 for snapshot=snaptb0-testExportFileSystemState 2023-07-17 13:11:30,213 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. completed. 2023-07-17 13:11:30,213 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:30,213 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:30,213 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:30,213 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,213 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:30,213 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:11:30,214 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. completed. 2023-07-17 13:11:30,214 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:30,214 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:30,214 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:30,214 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,214 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-17 13:11:30,214 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:11:30,219 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:30,219 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,219 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:30,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:30,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:30,219 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:30,221 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:30,221 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-17 13:11:30,222 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:30,222 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-17 13:11:30,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:30,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:30,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:30,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:30,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:11:30,226 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 13:11:30,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:30,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:30,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:30,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39513,1689599458171': 2023-07-17 13:11:30,230 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 13:11:30,230 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-17 13:11:30,230 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:30,230 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:30,230 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-17 13:11:30,230 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:30,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:30,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:30,233 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:30,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:30,233 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:30,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,234 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:30,235 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:30,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:30,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:30,236 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-17 13:11:30,237 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,237 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,240 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,241 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,241 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:30,241 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:30,241 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,241 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:30,241 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:30,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-17 13:11:30,241 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:30,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:30,241 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:30,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-17 13:11:30,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:30,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-17 13:11:30,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:11:30,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:30,241 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:30,242 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:30,241 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:30,241 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:30,244 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:30,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:30,244 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,244 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:30,244 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:30,244 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,244 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,244 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:30,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:30,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307172c3cbec4950144d6ac7767da87ad1bf8, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717f23f01718eef478bbe80a56e549096c6] mob files 2023-07-17 13:11:30,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307172c3cbec4950144d6ac7767da87ad1bf8 2023-07-17 13:11:30,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717f23f01718eef478bbe80a56e549096c6 2023-07-17 13:11:30,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-17 13:11:30,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,300 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-17 13:11:30,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,300 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,300 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1689599490013Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1689599490253 (+240 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1689599490253Loading Region manifests for snaptb0-testExportFileSystemState at 1689599490253Writing data manifest for snaptb0-testExportFileSystemState at 1689599490257 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1689599490265 (+8 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1689599490300 (+35 ms) 2023-07-17 13:11:30,303 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-17 13:11:30,305 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 289 msec 2023-07-17 13:11:30,323 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:30,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:11:30,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:30,325 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599490325 2023-07-17 13:11:30,325 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42441, tgtDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599490325, rawTgtDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599490325, srcFsUri=hdfs://localhost:42441, srcDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:11:30,356 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:11:30,356 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1545766717_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599490325, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599490325/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,356 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295, snapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-17 13:11:30,372 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599490325/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-17 13:11:30,413 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,414 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,414 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:30,415 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:31,458 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-1412155201117542847.jar 2023-07-17 13:11:31,459 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:31,459 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:31,540 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-89052886198220699.jar 2023-07-17 13:11:31,541 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:31,541 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:31,541 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:31,542 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:31,542 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:31,543 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:31,543 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:11:31,544 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:11:31,544 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:11:31,545 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:11:31,545 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:11:31,546 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:11:31,547 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:11:31,547 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:11:31,548 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:11:31,549 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:11:31,550 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:31,551 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:31,551 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:31,552 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:31,552 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:31,555 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:31,556 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:32,080 WARN [Listener at jenkins-hbase4.apache.org/45655] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:11:32,083 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-17 13:11:32,085 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-17 13:11:32,880 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:32,880 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:32,886 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0001_000001 (auth:SIMPLE) 2023-07-17 13:11:33,661 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0002_000001 (auth:SIMPLE) 2023-07-17 13:11:34,157 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:11:38,513 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0002_000001 (auth:SIMPLE) 2023-07-17 13:11:40,775 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0002_000001 (auth:SIMPLE) 2023-07-17 13:11:43,812 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0002_000001 (auth:SIMPLE) 2023-07-17 13:11:45,340 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:11:45,344 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:11:45,361 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-17 13:11:45,362 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:11:45,362 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:11:45,363 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 13:11:45,367 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 13:11:45,367 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 13:11:45,367 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599490325/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599490325/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-17 13:11:45,368 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599490325/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-17 13:11:45,368 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599490325/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-17 13:11:45,376 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-17 13:11:45,377 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-17 13:11:45,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 13:11:45,385 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599505385"}]},"ts":"1689599505385"} 2023-07-17 13:11:45,387 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 13:11:45,389 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-17 13:11:45,390 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7696948d1fbcc3d715f0e21a300ea19e, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2648189d324d898a0b0028f3d2b6352b, UNASSIGN}] 2023-07-17 13:11:45,392 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7696948d1fbcc3d715f0e21a300ea19e, UNASSIGN 2023-07-17 13:11:45,392 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2648189d324d898a0b0028f3d2b6352b, UNASSIGN 2023-07-17 13:11:45,393 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7696948d1fbcc3d715f0e21a300ea19e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:45,394 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2648189d324d898a0b0028f3d2b6352b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:45,394 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599505393"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599505393"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599505393"}]},"ts":"1689599505393"} 2023-07-17 13:11:45,394 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599505393"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599505393"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599505393"}]},"ts":"1689599505393"} 2023-07-17 13:11:45,395 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 7696948d1fbcc3d715f0e21a300ea19e, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:11:45,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 2648189d324d898a0b0028f3d2b6352b, server=jenkins-hbase4.apache.org,39513,1689599458171}] 2023-07-17 13:11:45,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 13:11:45,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:45,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7696948d1fbcc3d715f0e21a300ea19e, disabling compactions & flushes 2023-07-17 13:11:45,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:45,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:45,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. after waiting 0 ms 2023-07-17 13:11:45,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:45,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:45,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2648189d324d898a0b0028f3d2b6352b, disabling compactions & flushes 2023-07-17 13:11:45,552 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:45,552 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:45,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. after waiting 0 ms 2023-07-17 13:11:45,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:45,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:11:45,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:11:45,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:45,566 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e. 2023-07-17 13:11:45,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7696948d1fbcc3d715f0e21a300ea19e: 2023-07-17 13:11:45,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:11:45,567 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b. 2023-07-17 13:11:45,567 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2648189d324d898a0b0028f3d2b6352b: 2023-07-17 13:11:45,569 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:45,569 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=7696948d1fbcc3d715f0e21a300ea19e, regionState=CLOSED 2023-07-17 13:11:45,570 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599505569"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599505569"}]},"ts":"1689599505569"} 2023-07-17 13:11:45,570 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:45,570 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=2648189d324d898a0b0028f3d2b6352b, regionState=CLOSED 2023-07-17 13:11:45,571 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1689599505570"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599505570"}]},"ts":"1689599505570"} 2023-07-17 13:11:45,573 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-17 13:11:45,574 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 7696948d1fbcc3d715f0e21a300ea19e, server=jenkins-hbase4.apache.org,37517,1689599458122 in 176 msec 2023-07-17 13:11:45,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-17 13:11:45,574 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 2648189d324d898a0b0028f3d2b6352b, server=jenkins-hbase4.apache.org,39513,1689599458171 in 176 msec 2023-07-17 13:11:45,575 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=7696948d1fbcc3d715f0e21a300ea19e, UNASSIGN in 185 msec 2023-07-17 13:11:45,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-17 13:11:45,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=2648189d324d898a0b0028f3d2b6352b, UNASSIGN in 185 msec 2023-07-17 13:11:45,578 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599505577"}]},"ts":"1689599505577"} 2023-07-17 13:11:45,579 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 13:11:45,581 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-17 13:11:45,597 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 204 msec 2023-07-17 13:11:45,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-17 13:11:45,686 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-17 13:11:45,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-17 13:11:45,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,691 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-17 13:11:45,692 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,693 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-17 13:11:45,697 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,697 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,697 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,697 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,697 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 13:11:45,697 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 13:11:45,697 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-17 13:11:45,697 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:45,698 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:45,698 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,698 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,698 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-17 13:11:45,698 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,698 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,698 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,698 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:45,699 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-17 13:11:45,699 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:11:45,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 13:11:45,701 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/recovered.edits] 2023-07-17 13:11:45,701 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/recovered.edits] 2023-07-17 13:11:45,706 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/cf/9ca6c6bf2ccb41c9be3179d8bc8cba03 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/cf/9ca6c6bf2ccb41c9be3179d8bc8cba03 2023-07-17 13:11:45,706 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/cf/1fbf722686684a769e66884ee972eeac to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/cf/1fbf722686684a769e66884ee972eeac 2023-07-17 13:11:45,710 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b/recovered.edits/9.seqid 2023-07-17 13:11:45,710 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e/recovered.edits/9.seqid 2023-07-17 13:11:45,710 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/2648189d324d898a0b0028f3d2b6352b 2023-07-17 13:11:45,710 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemState/7696948d1fbcc3d715f0e21a300ea19e 2023-07-17 13:11:45,710 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-17 13:11:45,711 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-17 13:11:45,712 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-17 13:11:45,716 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307172c3cbec4950144d6ac7767da87ad1bf8 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b202307172c3cbec4950144d6ac7767da87ad1bf8 2023-07-17 13:11:45,718 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717f23f01718eef478bbe80a56e549096c6 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e20230717f23f01718eef478bbe80a56e549096c6 2023-07-17 13:11:45,718 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-17 13:11:45,721 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,724 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-17 13:11:45,726 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-17 13:11:45,728 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,728 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-17 13:11:45,728 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599505728"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:45,728 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599505728"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:45,730 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:11:45,730 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7696948d1fbcc3d715f0e21a300ea19e, NAME => 'testtb-testExportFileSystemState,,1689599488857.7696948d1fbcc3d715f0e21a300ea19e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2648189d324d898a0b0028f3d2b6352b, NAME => 'testtb-testExportFileSystemState,1,1689599488857.2648189d324d898a0b0028f3d2b6352b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:11:45,730 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-17 13:11:45,731 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599505731"}]},"ts":"9223372036854775807"} 2023-07-17 13:11:45,732 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-17 13:11:45,735 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-17 13:11:45,736 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 48 msec 2023-07-17 13:11:45,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-17 13:11:45,801 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-17 13:11:45,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-17 13:11:45,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-17 13:11:45,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-17 13:11:45,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-17 13:11:45,842 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=763 (was 751) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1332439996_1 at /127.0.0.1:32996 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:37388 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (119954474) connection to jenkins-hbase4.apache.org/172.31.14.131:43737 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2032 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:53338 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:33012 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=920 (was 921), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=398 (was 430), ProcessCount=181 (was 181), AvailableMemoryMB=3212 (was 3383) 2023-07-17 13:11:45,842 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-17 13:11:45,864 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=763, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=398, ProcessCount=181, AvailableMemoryMB=3210 2023-07-17 13:11:45,864 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-07-17 13:11:45,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 13:11:45,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:11:45,870 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:11:45,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-17 13:11:45,871 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:11:45,871 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 13:11:45,874 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:11:45,874 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:11:45,874 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61 empty. 2023-07-17 13:11:45,874 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e empty. 2023-07-17 13:11:45,875 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:11:45,875 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:11:45,875 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 13:11:45,892 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-17 13:11:45,893 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => af920644355ce6d3b676b7ef75be6a3e, NAME => 'testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:11:45,894 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 435d60469f1474a236cb25ac4ed4df61, NAME => 'testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:11:45,920 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:45,920 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:45,920 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 435d60469f1474a236cb25ac4ed4df61, disabling compactions & flushes 2023-07-17 13:11:45,920 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing af920644355ce6d3b676b7ef75be6a3e, disabling compactions & flushes 2023-07-17 13:11:45,920 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:45,920 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:45,920 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:45,920 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:45,921 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. after waiting 1 ms 2023-07-17 13:11:45,921 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:45,921 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. after waiting 0 ms 2023-07-17 13:11:45,921 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:45,921 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 435d60469f1474a236cb25ac4ed4df61: 2023-07-17 13:11:45,921 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:45,921 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:45,921 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for af920644355ce6d3b676b7ef75be6a3e: 2023-07-17 13:11:45,924 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:11:45,925 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599505924"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599505924"}]},"ts":"1689599505924"} 2023-07-17 13:11:45,925 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599505924"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599505924"}]},"ts":"1689599505924"} 2023-07-17 13:11:45,927 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:11:45,930 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:11:45,931 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599505931"}]},"ts":"1689599505931"} 2023-07-17 13:11:45,932 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-17 13:11:45,937 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:11:45,938 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:11:45,938 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:11:45,938 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:11:45,938 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:11:45,939 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=435d60469f1474a236cb25ac4ed4df61, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af920644355ce6d3b676b7ef75be6a3e, ASSIGN}] 2023-07-17 13:11:45,942 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af920644355ce6d3b676b7ef75be6a3e, ASSIGN 2023-07-17 13:11:45,942 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=435d60469f1474a236cb25ac4ed4df61, ASSIGN 2023-07-17 13:11:45,943 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af920644355ce6d3b676b7ef75be6a3e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37517,1689599458122; forceNewPlan=false, retain=false 2023-07-17 13:11:45,944 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=435d60469f1474a236cb25ac4ed4df61, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32803,1689599458048; forceNewPlan=false, retain=false 2023-07-17 13:11:45,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 13:11:46,094 INFO [jenkins-hbase4:42365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:11:46,097 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=af920644355ce6d3b676b7ef75be6a3e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,098 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599506097"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599506097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599506097"}]},"ts":"1689599506097"} 2023-07-17 13:11:46,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=435d60469f1474a236cb25ac4ed4df61, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599506098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599506098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599506098"}]},"ts":"1689599506098"} 2023-07-17 13:11:46,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure af920644355ce6d3b676b7ef75be6a3e, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:11:46,102 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 435d60469f1474a236cb25ac4ed4df61, server=jenkins-hbase4.apache.org,32803,1689599458048}] 2023-07-17 13:11:46,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 13:11:46,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:46,262 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:46,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => af920644355ce6d3b676b7ef75be6a3e, NAME => 'testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:11:46,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 435d60469f1474a236cb25ac4ed4df61, NAME => 'testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:11:46,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. service=AccessControlService 2023-07-17 13:11:46,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. service=AccessControlService 2023-07-17 13:11:46,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:46,263 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:11:46,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:11:46,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:11:46,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:46,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:11:46,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:11:46,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:11:46,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:11:46,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:11:46,265 INFO [StoreOpener-af920644355ce6d3b676b7ef75be6a3e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:11:46,266 INFO [StoreOpener-435d60469f1474a236cb25ac4ed4df61-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:11:46,267 DEBUG [StoreOpener-af920644355ce6d3b676b7ef75be6a3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/cf 2023-07-17 13:11:46,267 DEBUG [StoreOpener-af920644355ce6d3b676b7ef75be6a3e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/cf 2023-07-17 13:11:46,268 INFO [StoreOpener-af920644355ce6d3b676b7ef75be6a3e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region af920644355ce6d3b676b7ef75be6a3e columnFamilyName cf 2023-07-17 13:11:46,268 DEBUG [StoreOpener-435d60469f1474a236cb25ac4ed4df61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/cf 2023-07-17 13:11:46,268 DEBUG [StoreOpener-435d60469f1474a236cb25ac4ed4df61-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/cf 2023-07-17 13:11:46,268 INFO [StoreOpener-435d60469f1474a236cb25ac4ed4df61-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 435d60469f1474a236cb25ac4ed4df61 columnFamilyName cf 2023-07-17 13:11:46,270 INFO [StoreOpener-435d60469f1474a236cb25ac4ed4df61-1] regionserver.HStore(310): Store=435d60469f1474a236cb25ac4ed4df61/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:46,270 INFO [StoreOpener-af920644355ce6d3b676b7ef75be6a3e-1] regionserver.HStore(310): Store=af920644355ce6d3b676b7ef75be6a3e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:11:46,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:11:46,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:11:46,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:11:46,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:11:46,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:11:46,275 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:11:46,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:46,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:11:46,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 435d60469f1474a236cb25ac4ed4df61; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59248259, jitterRate=-0.11713214218616486}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:46,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened af920644355ce6d3b676b7ef75be6a3e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63777893, jitterRate=-0.04963533580303192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:11:46,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 435d60469f1474a236cb25ac4ed4df61: 2023-07-17 13:11:46,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for af920644355ce6d3b676b7ef75be6a3e: 2023-07-17 13:11:46,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e., pid=45, masterSystemTime=1689599506255 2023-07-17 13:11:46,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61., pid=46, masterSystemTime=1689599506255 2023-07-17 13:11:46,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:46,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:46,282 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=af920644355ce6d3b676b7ef75be6a3e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,282 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599506282"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599506282"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599506282"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599506282"}]},"ts":"1689599506282"} 2023-07-17 13:11:46,282 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:46,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:46,283 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=435d60469f1474a236cb25ac4ed4df61, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,283 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599506283"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599506283"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599506283"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599506283"}]},"ts":"1689599506283"} 2023-07-17 13:11:46,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-17 13:11:46,292 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure af920644355ce6d3b676b7ef75be6a3e, server=jenkins-hbase4.apache.org,37517,1689599458122 in 188 msec 2023-07-17 13:11:46,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-17 13:11:46,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 435d60469f1474a236cb25ac4ed4df61, server=jenkins-hbase4.apache.org,32803,1689599458048 in 189 msec 2023-07-17 13:11:46,295 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af920644355ce6d3b676b7ef75be6a3e, ASSIGN in 354 msec 2023-07-17 13:11:46,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-17 13:11:46,297 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=435d60469f1474a236cb25ac4ed4df61, ASSIGN in 355 msec 2023-07-17 13:11:46,297 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:11:46,298 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599506298"}]},"ts":"1689599506298"} 2023-07-17 13:11:46,299 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-17 13:11:46,301 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:11:46,302 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-17 13:11:46,304 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 13:11:46,305 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:46,305 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:46,305 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:46,305 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:11:46,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:46,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:46,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:46,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-17 13:11:46,310 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 441 msec 2023-07-17 13:11:46,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-17 13:11:46,476 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-17 13:11:46,479 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-17 13:11:46,479 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:46,481 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:46,495 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:46,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599506495 (current time:1689599506495). 2023-07-17 13:11:46,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:46,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x63f6accd to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:46,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c8d9b00, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:46,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:46,519 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:46,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x63f6accd to 127.0.0.1:62970 2023-07-17 13:11:46,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:46,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x0bd3254b to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:46,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d957038, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:46,533 DEBUG [hconnection-0x2db0a511-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:46,538 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:46,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:46,547 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:46,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0bd3254b to 127.0.0.1:62970 2023-07-17 13:11:46,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:46,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 13:11:46,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:46,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:46,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:46,554 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:46,555 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689600106555 2023-07-17 13:11:46,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:46,555 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 13:11:46,556 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:46,556 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:46,557 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:46,558 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:46,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-17 13:11:46,561 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:46,561 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689600106561 2023-07-17 13:11:46,579 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,579 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-17 13:11:46,579 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,580 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 13:11:46,580 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 13:11:46,581 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,581 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,582 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,582 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,582 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,582 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,582 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,583 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,583 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,583 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,583 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,584 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-17 13:11:46,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,585 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:46,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,585 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:46,585 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:46,585 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,585 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,585 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:46,585 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,586 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:46,586 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:46,592 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:46,587 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:46,593 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:46,593 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:46,593 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:46,593 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:46,593 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:46,593 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:46,595 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,595 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:46,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,595 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 13:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@754ddbdf[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-17 13:11:46,600 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@754ddbdf[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:46,600 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 13:11:46,600 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,602 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,602 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,602 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,602 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,602 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:46,602 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:46,603 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:46,603 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:46,603 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. started... 2023-07-17 13:11:46,603 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:46,603 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:46,602 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:11:46,602 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,604 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:46,603 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. started... 2023-07-17 13:11:46,604 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af920644355ce6d3b676b7ef75be6a3e: 2023-07-17 13:11:46,604 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 435d60469f1474a236cb25ac4ed4df61: 2023-07-17 13:11:46,604 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,605 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,606 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:46,606 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:46,606 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:46,606 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:11:46,609 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:46,609 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,609 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:46,638 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. completed. 2023-07-17 13:11:46,638 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:46,638 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. completed. 2023-07-17 13:11:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:46,638 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:11:46,638 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:11:46,640 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:46,640 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,640 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:46,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,640 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,640 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,640 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,640 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:46,641 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:46,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:11:46,646 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 13:11:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,32803,1689599458048': 2023-07-17 13:11:46,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 13:11:46,649 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-17 13:11:46,649 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:46,649 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:46,649 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,649 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:46,651 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,651 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,651 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,651 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,651 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,651 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,651 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,652 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,652 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,653 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,655 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:46,655 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,656 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,657 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:46,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 13:11:46,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:46,658 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:46,659 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,660 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,660 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,660 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,660 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:46,660 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,660 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:46,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,660 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,660 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:46,661 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-17 13:11:46,660 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,660 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,661 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:11:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:46,661 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:46,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,661 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,662 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:46,662 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:46,662 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,662 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:46,662 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:46,662 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,662 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 13:11:46,673 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,674 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,694 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,732 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 13:11:46,732 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,733 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-17 13:11:46,733 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689599506555Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689599506673 (+118 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1689599506673Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1689599506674 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1689599506678 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1689599506687 (+9 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689599506732 (+45 ms) 2023-07-17 13:11:46,738 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:46,740 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 182 msec 2023-07-17 13:11:46,858 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:46,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 13:11:46,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:46,862 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32803] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:46,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37517] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:11:46,868 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-17 13:11:46,868 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:46,869 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:11:46,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:46,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599506881 (current time:1689599506881). 2023-07-17 13:11:46,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:11:46,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x3bbf983e to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:46,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@fcef069, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:46,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:46,898 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:46,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bbf983e to 127.0.0.1:62970 2023-07-17 13:11:46,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:46,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x2293b22a to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:11:46,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@652ab02e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:11:47,009 DEBUG [hconnection-0x1d1f495a-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:47,013 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:47,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:11:47,018 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:11:47,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2293b22a to 127.0.0.1:62970 2023-07-17 13:11:47,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:11:47,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-17 13:11:47,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:11:47,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:47,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:47,025 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:47,026 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1689600107026 2023-07-17 13:11:47,026 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-17 13:11:47,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-17 13:11:47,027 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:11:47,028 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:11:47,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:47,029 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-17 13:11:47,030 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-07-17 13:11:47,031 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:47,032 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1689600107032 2023-07-17 13:11:47,045 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-17 13:11:47,045 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-17 13:11:47,045 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:47,046 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-17 13:11:47,046 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-17 13:11:47,047 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,047 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,048 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,048 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:47,048 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:47,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:47,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:47,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:47,048 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:47,049 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:47,049 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:47,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:47,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,049 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,049 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:11:47,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 13:11:47,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-17 13:11:47,050 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:47,050 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:47,050 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:47,050 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-17 13:11:47,051 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:47,052 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:47,050 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:47,052 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:47,052 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:11:47,052 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:47,053 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:47,053 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:47,053 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-17 13:11:47,054 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-17 13:11:47,054 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-17 13:11:47,055 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,055 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,055 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:47,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,056 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,057 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:47,056 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:47,057 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,057 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:11:47,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:47,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:47,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 13:11:47,059 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2404c84c[Count = 1] remaining members to acquire global barrier 2023-07-17 13:11:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:47,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:47,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-17 13:11:47,061 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2404c84c[Count = 0] remaining members to acquire global barrier 2023-07-17 13:11:47,061 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-17 13:11:47,061 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,062 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,062 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,062 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,063 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:47,063 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:47,063 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,063 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:47,063 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:47,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,063 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:11:47,063 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:11:47,063 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,063 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:11:47,063 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:47,063 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-17 13:11:47,063 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. started... 2023-07-17 13:11:47,063 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:47,063 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:47,063 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:11:47,063 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. started... 2023-07-17 13:11:47,063 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 435d60469f1474a236cb25ac4ed4df61 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-17 13:11:47,064 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2745): Flushing af920644355ce6d3b676b7ef75be6a3e 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-17 13:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:47,067 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:47,101 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307170bc44ab15fa8434b892139d7d18ea9ee to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307170bc44ab15fa8434b892139d7d18ea9ee 2023-07-17 13:11:47,103 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307177d7fc8e955424387b259cb90e351f5bb to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307177d7fc8e955424387b259cb90e351f5bb 2023-07-17 13:11:47,120 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/.tmp/cf/3441c145db6443778ded7179246adab8 2023-07-17 13:11:47,122 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/.tmp/cf/f6ac98b73cb34a9f8edab6046ebce51b 2023-07-17 13:11:47,128 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:47,128 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/.tmp/cf/f6ac98b73cb34a9f8edab6046ebce51b as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/cf/f6ac98b73cb34a9f8edab6046ebce51b 2023-07-17 13:11:47,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 13:11:47,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:47,129 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:11:47,130 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/.tmp/cf/3441c145db6443778ded7179246adab8 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/cf/3441c145db6443778ded7179246adab8 2023-07-17 13:11:47,134 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/cf/f6ac98b73cb34a9f8edab6046ebce51b, entries=2, sequenceid=6, filesize=5.2 K 2023-07-17 13:11:47,135 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 435d60469f1474a236cb25ac4ed4df61 in 72ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:47,135 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-17 13:11:47,136 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 435d60469f1474a236cb25ac4ed4df61: 2023-07-17 13:11:47,136 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 13:11:47,136 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:47,136 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/cf/f6ac98b73cb34a9f8edab6046ebce51b] hfiles 2023-07-17 13:11:47,137 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/cf/f6ac98b73cb34a9f8edab6046ebce51b for snapshot=snaptb0-testConsecutiveExports 2023-07-17 13:11:47,137 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/cf/3441c145db6443778ded7179246adab8, entries=48, sequenceid=6, filesize=12.9 K 2023-07-17 13:11:47,138 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for af920644355ce6d3b676b7ef75be6a3e in 74ms, sequenceid=6, compaction requested=false 2023-07-17 13:11:47,140 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for af920644355ce6d3b676b7ef75be6a3e: 2023-07-17 13:11:47,140 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 13:11:47,140 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:11:47,140 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/cf/3441c145db6443778ded7179246adab8] hfiles 2023-07-17 13:11:47,140 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/cf/3441c145db6443778ded7179246adab8 for snapshot=snaptb0-testConsecutiveExports 2023-07-17 13:11:47,167 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. completed. 2023-07-17 13:11:47,167 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:11:47,167 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:47,167 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:47,167 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,168 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:47,168 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:11:47,170 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:47,171 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:47,171 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:47,173 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:47,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:47,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,32803,1689599458048': 2023-07-17 13:11:47,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-17 13:11:47,329 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:47,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 13:11:47,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:47,331 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:11:47,568 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. completed. 2023-07-17 13:11:47,568 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:11:47,568 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:11:47,569 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:11:47,569 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,569 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-17 13:11:47,569 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:11:47,571 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,571 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-17 13:11:47,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:47,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:47,571 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:47,572 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-17 13:11:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:47,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:47,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:47,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:11:47,577 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-17 13:11:47,577 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-17 13:11:47,577 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:11:47,577 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:11:47,577 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-17 13:11:47,577 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:11:47,579 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,579 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,579 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:47,579 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:47,579 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,579 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,579 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:11:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:11:47,579 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,579 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:47,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:11:47,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:47,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:47,580 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,580 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:47,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:47,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:47,580 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,580 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:11:47,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,583 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:11:47,583 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-17 13:11:47,583 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,590 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:47,590 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:47,590 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:11:47,590 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:47,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:47,590 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:47,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:47,590 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:11:47,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:47,591 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:11:47,590 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:47,590 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:11:47,591 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-17 13:11:47,590 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:47,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:47,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:11:47,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:47,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:47,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,592 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-17 13:11:47,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:11:47,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-17 13:11:47,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:11:47,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:11:47,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:11:47,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:11:47,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:11:47,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307177d7fc8e955424387b259cb90e351f5bb, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307170bc44ab15fa8434b892139d7d18ea9ee] mob files 2023-07-17 13:11:47,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307177d7fc8e955424387b259cb90e351f5bb 2023-07-17 13:11:47,595 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307170bc44ab15fa8434b892139d7d18ea9ee 2023-07-17 13:11:47,606 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-17 13:11:47,607 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,631 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:47,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 13:11:47,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:11:47,633 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 13:11:47,644 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-17 13:11:47,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,644 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:11:47,644 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1689599507026Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1689599507606 (+580 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1689599507606Loading Region manifests for snaptb0-testConsecutiveExports at 1689599507606Writing data manifest for snaptb0-testConsecutiveExports at 1689599507610 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1689599507618 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1689599507644 (+26 ms) 2023-07-17 13:11:47,647 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-17 13:11:47,649 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 620 msec 2023-07-17 13:11:48,133 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:11:48,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-17 13:11:48,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:11:48,134 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134 2023-07-17 13:11:48,135 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134, srcFsUri=hdfs://localhost:42441, srcDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:11:48,165 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:11:48,165 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@582c309b, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:11:48,165 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295, snapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 13:11:48,180 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:11:48,205 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:48,205 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:48,206 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:48,206 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:49,135 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-2450595849533166906.jar 2023-07-17 13:11:49,136 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:49,136 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:49,203 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-8012616102676835248.jar 2023-07-17 13:11:49,203 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:49,204 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:49,204 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:49,204 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:49,205 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:49,205 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:11:49,205 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:11:49,206 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:11:49,206 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:11:49,206 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:11:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:11:49,207 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:11:49,208 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:11:49,208 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:11:49,208 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:11:49,209 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:11:49,209 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:49,210 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:49,210 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:49,211 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:49,211 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:11:49,211 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:49,212 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:11:49,619 WARN [Listener at jenkins-hbase4.apache.org/45655] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:11:49,622 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 13:11:49,624 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-17 13:11:49,984 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:49,984 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:11:49,987 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0002_000001 (auth:SIMPLE) 2023-07-17 13:11:50,895 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0003_000001 (auth:SIMPLE) 2023-07-17 13:11:51,152 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:11:55,543 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0003_000001 (auth:SIMPLE) 2023-07-17 13:11:57,795 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0003_000001 (auth:SIMPLE) 2023-07-17 13:12:00,394 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0003_000001 (auth:SIMPLE) 2023-07-17 13:12:01,799 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:12:01,800 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:12:01,804 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 13:12:01,804 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:12:01,805 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:12:01,805 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 13:12:01,806 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 13:12:01,806 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 13:12:01,806 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4b796de4 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 13:12:01,806 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 13:12:01,806 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 13:12:01,807 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134, srcFsUri=hdfs://localhost:42441, srcDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:12:01,829 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:12:01,829 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@1e05e9cc, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:12:01,829 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295, snapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-17 13:12:01,841 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-17 13:12:01,856 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:01,856 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:01,857 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:01,857 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,808 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-7269457450565946483.jar 2023-07-17 13:12:02,809 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,809 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,884 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-8721698834937828835.jar 2023-07-17 13:12:02,885 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,885 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,885 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,886 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,886 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,887 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:02,887 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:12:02,888 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:12:02,888 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:12:02,889 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:12:02,889 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:12:02,890 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:12:02,890 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:12:02,890 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:12:02,891 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:12:02,891 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:12:02,892 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:02,892 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:02,893 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:02,893 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:02,893 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:02,894 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:02,894 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:03,329 WARN [Listener at jenkins-hbase4.apache.org/45655] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:12:03,332 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-17 13:12:03,334 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-17 13:12:06,570 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:06,571 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:06,573 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0003_000001 (auth:SIMPLE) 2023-07-17 13:12:07,000 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0004_000001 (auth:SIMPLE) 2023-07-17 13:12:11,980 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0004_000001 (auth:SIMPLE) 2023-07-17 13:12:14,377 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0004_000001 (auth:SIMPLE) 2023-07-17 13:12:19,986 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0004_000001 (auth:SIMPLE) 2023-07-17 13:12:21,550 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:12:21,550 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:12:21,554 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-17 13:12:21,554 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:12:21,554 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:12:21,554 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 13:12:21,557 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 13:12:21,557 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 13:12:21,557 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@4b796de4 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-17 13:12:21,558 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-17 13:12:21,558 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/local-export-1689599508134/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-17 13:12:21,570 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-17 13:12:21,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-17 13:12:21,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:21,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 13:12:21,576 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599541576"}]},"ts":"1689599541576"} 2023-07-17 13:12:21,578 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-17 13:12:21,580 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-17 13:12:21,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=435d60469f1474a236cb25ac4ed4df61, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af920644355ce6d3b676b7ef75be6a3e, UNASSIGN}] 2023-07-17 13:12:21,583 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=435d60469f1474a236cb25ac4ed4df61, UNASSIGN 2023-07-17 13:12:21,583 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af920644355ce6d3b676b7ef75be6a3e, UNASSIGN 2023-07-17 13:12:21,584 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=435d60469f1474a236cb25ac4ed4df61, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:21,584 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=af920644355ce6d3b676b7ef75be6a3e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:21,584 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599541584"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599541584"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599541584"}]},"ts":"1689599541584"} 2023-07-17 13:12:21,584 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599541584"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599541584"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599541584"}]},"ts":"1689599541584"} 2023-07-17 13:12:21,586 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure af920644355ce6d3b676b7ef75be6a3e, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:12:21,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 435d60469f1474a236cb25ac4ed4df61, server=jenkins-hbase4.apache.org,32803,1689599458048}] 2023-07-17 13:12:21,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 13:12:21,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:12:21,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing af920644355ce6d3b676b7ef75be6a3e, disabling compactions & flushes 2023-07-17 13:12:21,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:12:21,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:12:21,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. after waiting 0 ms 2023-07-17 13:12:21,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:12:21,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:12:21,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 435d60469f1474a236cb25ac4ed4df61, disabling compactions & flushes 2023-07-17 13:12:21,740 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:12:21,742 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:12:21,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. after waiting 0 ms 2023-07-17 13:12:21,745 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:12:21,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:21,758 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:21,764 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e. 2023-07-17 13:12:21,764 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for af920644355ce6d3b676b7ef75be6a3e: 2023-07-17 13:12:21,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:21,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:21,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61. 2023-07-17 13:12:21,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 435d60469f1474a236cb25ac4ed4df61: 2023-07-17 13:12:21,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:12:21,769 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=af920644355ce6d3b676b7ef75be6a3e, regionState=CLOSED 2023-07-17 13:12:21,769 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599541769"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599541769"}]},"ts":"1689599541769"} 2023-07-17 13:12:21,771 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=435d60469f1474a236cb25ac4ed4df61, regionState=CLOSED 2023-07-17 13:12:21,772 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1689599541771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599541771"}]},"ts":"1689599541771"} 2023-07-17 13:12:21,772 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:12:21,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=53 2023-07-17 13:12:21,773 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure af920644355ce6d3b676b7ef75be6a3e, server=jenkins-hbase4.apache.org,37517,1689599458122 in 185 msec 2023-07-17 13:12:21,774 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=af920644355ce6d3b676b7ef75be6a3e, UNASSIGN in 192 msec 2023-07-17 13:12:21,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=52 2023-07-17 13:12:21,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 435d60469f1474a236cb25ac4ed4df61, server=jenkins-hbase4.apache.org,32803,1689599458048 in 186 msec 2023-07-17 13:12:21,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-17 13:12:21,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=435d60469f1474a236cb25ac4ed4df61, UNASSIGN in 195 msec 2023-07-17 13:12:21,778 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599541778"}]},"ts":"1689599541778"} 2023-07-17 13:12:21,779 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-17 13:12:21,781 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-17 13:12:21,783 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 211 msec 2023-07-17 13:12:21,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-17 13:12:21,879 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-17 13:12:21,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-17 13:12:21,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:21,884 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:21,885 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-17 13:12:21,885 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:21,890 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-17 13:12:21,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:21,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:21,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:21,897 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 13:12:21,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 13:12:21,898 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-17 13:12:21,898 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:12:21,899 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:21,899 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:21,899 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:21,899 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:21,899 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:21,899 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:21,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 13:12:21,901 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-17 13:12:21,901 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:21,902 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data null 2023-07-17 13:12:21,902 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:12:21,915 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:12:21,921 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/recovered.edits] 2023-07-17 13:12:21,927 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/cf/f6ac98b73cb34a9f8edab6046ebce51b to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/cf/f6ac98b73cb34a9f8edab6046ebce51b 2023-07-17 13:12:21,927 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/recovered.edits] 2023-07-17 13:12:21,931 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61/recovered.edits/9.seqid 2023-07-17 13:12:21,932 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/435d60469f1474a236cb25ac4ed4df61 2023-07-17 13:12:21,932 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/cf/3441c145db6443778ded7179246adab8 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/cf/3441c145db6443778ded7179246adab8 2023-07-17 13:12:21,935 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e/recovered.edits/9.seqid 2023-07-17 13:12:21,936 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testConsecutiveExports/af920644355ce6d3b676b7ef75be6a3e 2023-07-17 13:12:21,936 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-17 13:12:21,936 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-17 13:12:21,937 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-17 13:12:21,941 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307177d7fc8e955424387b259cb90e351f5bb to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b202307177d7fc8e955424387b259cb90e351f5bb 2023-07-17 13:12:21,943 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307170bc44ab15fa8434b892139d7d18ea9ee to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307170bc44ab15fa8434b892139d7d18ea9ee 2023-07-17 13:12:21,943 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-17 13:12:21,947 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:21,955 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-17 13:12:21,968 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-17 13:12:21,969 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:21,970 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-17 13:12:21,970 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599541970"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:21,970 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599541970"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:21,972 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:12:21,972 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 435d60469f1474a236cb25ac4ed4df61, NAME => 'testtb-testConsecutiveExports,,1689599505866.435d60469f1474a236cb25ac4ed4df61.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => af920644355ce6d3b676b7ef75be6a3e, NAME => 'testtb-testConsecutiveExports,1,1689599505866.af920644355ce6d3b676b7ef75be6a3e.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:12:21,972 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-17 13:12:21,972 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599541972"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:21,974 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-17 13:12:21,977 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-17 13:12:21,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 97 msec 2023-07-17 13:12:22,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-17 13:12:22,002 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-17 13:12:22,010 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-17 13:12:22,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-17 13:12:22,013 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-17 13:12:22,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-17 13:12:22,047 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 763), OpenFileDescriptor=896 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=436 (was 398) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=2544 (was 3210) 2023-07-17 13:12:22,047 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-17 13:12:22,070 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=896, MaxFileDescriptor=60000, SystemLoadAverage=436, ProcessCount=183, AvailableMemoryMB=2543 2023-07-17 13:12:22,071 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-17 13:12:22,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 13:12:22,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,081 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:12:22,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-17 13:12:22,083 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:12:22,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 13:12:22,088 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:22,088 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:22,089 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad empty. 2023-07-17 13:12:22,089 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825 empty. 2023-07-17 13:12:22,089 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:22,090 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:22,090 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 13:12:22,125 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-17 13:12:22,126 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => ba215d4b7eaa183638f71607516f7825, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:12:22,126 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 796d33079cf86572e77dd3dcee21c2ad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:12:22,153 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:22,153 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:22,153 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 796d33079cf86572e77dd3dcee21c2ad, disabling compactions & flushes 2023-07-17 13:12:22,153 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing ba215d4b7eaa183638f71607516f7825, disabling compactions & flushes 2023-07-17 13:12:22,153 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:22,153 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:22,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:22,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:22,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. after waiting 0 ms 2023-07-17 13:12:22,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. after waiting 0 ms 2023-07-17 13:12:22,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:22,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:22,154 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:22,154 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:22,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 796d33079cf86572e77dd3dcee21c2ad: 2023-07-17 13:12:22,154 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for ba215d4b7eaa183638f71607516f7825: 2023-07-17 13:12:22,157 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:12:22,158 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599542158"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599542158"}]},"ts":"1689599542158"} 2023-07-17 13:12:22,158 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599542158"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599542158"}]},"ts":"1689599542158"} 2023-07-17 13:12:22,165 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:12:22,166 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:12:22,166 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599542166"}]},"ts":"1689599542166"} 2023-07-17 13:12:22,168 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-17 13:12:22,172 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:12:22,174 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:12:22,174 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:12:22,174 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:12:22,174 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:12:22,174 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba215d4b7eaa183638f71607516f7825, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=796d33079cf86572e77dd3dcee21c2ad, ASSIGN}] 2023-07-17 13:12:22,177 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=796d33079cf86572e77dd3dcee21c2ad, ASSIGN 2023-07-17 13:12:22,177 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba215d4b7eaa183638f71607516f7825, ASSIGN 2023-07-17 13:12:22,178 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba215d4b7eaa183638f71607516f7825, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39513,1689599458171; forceNewPlan=false, retain=false 2023-07-17 13:12:22,178 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=796d33079cf86572e77dd3dcee21c2ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37517,1689599458122; forceNewPlan=false, retain=false 2023-07-17 13:12:22,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 13:12:22,328 INFO [jenkins-hbase4:42365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:12:22,331 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ba215d4b7eaa183638f71607516f7825, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,331 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=796d33079cf86572e77dd3dcee21c2ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,332 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599542331"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599542331"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599542331"}]},"ts":"1689599542331"} 2023-07-17 13:12:22,332 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599542331"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599542331"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599542331"}]},"ts":"1689599542331"} 2023-07-17 13:12:22,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure ba215d4b7eaa183638f71607516f7825, server=jenkins-hbase4.apache.org,39513,1689599458171}] 2023-07-17 13:12:22,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 796d33079cf86572e77dd3dcee21c2ad, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:12:22,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 13:12:22,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:22,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 796d33079cf86572e77dd3dcee21c2ad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:12:22,498 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. service=AccessControlService 2023-07-17 13:12:22,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:22,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ba215d4b7eaa183638f71607516f7825, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:12:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. service=AccessControlService 2023-07-17 13:12:22,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:22,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:22,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:22,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:22,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:22,501 INFO [StoreOpener-796d33079cf86572e77dd3dcee21c2ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:22,502 INFO [StoreOpener-ba215d4b7eaa183638f71607516f7825-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:22,503 DEBUG [StoreOpener-796d33079cf86572e77dd3dcee21c2ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/cf 2023-07-17 13:12:22,503 DEBUG [StoreOpener-ba215d4b7eaa183638f71607516f7825-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/cf 2023-07-17 13:12:22,503 DEBUG [StoreOpener-ba215d4b7eaa183638f71607516f7825-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/cf 2023-07-17 13:12:22,503 DEBUG [StoreOpener-796d33079cf86572e77dd3dcee21c2ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/cf 2023-07-17 13:12:22,505 INFO [StoreOpener-796d33079cf86572e77dd3dcee21c2ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 796d33079cf86572e77dd3dcee21c2ad columnFamilyName cf 2023-07-17 13:12:22,505 INFO [StoreOpener-ba215d4b7eaa183638f71607516f7825-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba215d4b7eaa183638f71607516f7825 columnFamilyName cf 2023-07-17 13:12:22,507 INFO [StoreOpener-796d33079cf86572e77dd3dcee21c2ad-1] regionserver.HStore(310): Store=796d33079cf86572e77dd3dcee21c2ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:22,507 INFO [StoreOpener-ba215d4b7eaa183638f71607516f7825-1] regionserver.HStore(310): Store=ba215d4b7eaa183638f71607516f7825/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:22,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:22,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:22,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:22,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:22,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:22,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:22,522 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:22,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ba215d4b7eaa183638f71607516f7825; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74123614, jitterRate=0.10452792048454285}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:22,523 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:22,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ba215d4b7eaa183638f71607516f7825: 2023-07-17 13:12:22,524 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 796d33079cf86572e77dd3dcee21c2ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69973712, jitterRate=0.04268956184387207}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:22,524 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 796d33079cf86572e77dd3dcee21c2ad: 2023-07-17 13:12:22,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825., pid=60, masterSystemTime=1689599542490 2023-07-17 13:12:22,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad., pid=61, masterSystemTime=1689599542490 2023-07-17 13:12:22,527 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:22,527 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:22,528 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=ba215d4b7eaa183638f71607516f7825, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,529 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:22,529 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599542528"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599542528"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599542528"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599542528"}]},"ts":"1689599542528"} 2023-07-17 13:12:22,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:22,529 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=796d33079cf86572e77dd3dcee21c2ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,529 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599542529"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599542529"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599542529"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599542529"}]},"ts":"1689599542529"} 2023-07-17 13:12:22,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-17 13:12:22,533 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure ba215d4b7eaa183638f71607516f7825, server=jenkins-hbase4.apache.org,39513,1689599458171 in 197 msec 2023-07-17 13:12:22,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-17 13:12:22,534 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba215d4b7eaa183638f71607516f7825, ASSIGN in 359 msec 2023-07-17 13:12:22,534 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 796d33079cf86572e77dd3dcee21c2ad, server=jenkins-hbase4.apache.org,37517,1689599458122 in 196 msec 2023-07-17 13:12:22,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-17 13:12:22,536 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=796d33079cf86572e77dd3dcee21c2ad, ASSIGN in 360 msec 2023-07-17 13:12:22,537 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:12:22,537 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599542537"}]},"ts":"1689599542537"} 2023-07-17 13:12:22,538 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-17 13:12:22,541 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:12:22,541 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-17 13:12:22,544 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 13:12:22,545 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:22,545 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:22,545 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:22,545 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:22,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,548 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,549 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:22,555 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 475 msec 2023-07-17 13:12:22,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-17 13:12:22,691 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-17 13:12:22,695 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,695 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:22,699 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:22,721 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:22,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599542721 (current time:1689599542721). 2023-07-17 13:12:22,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:22,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x7af7a12b to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:22,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@19da9566, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:22,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:22,740 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42502, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:22,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7af7a12b to 127.0.0.1:62970 2023-07-17 13:12:22,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:22,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x7e0fbcd0 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:22,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3936b4c3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:22,762 DEBUG [hconnection-0x740a7726-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:22,763 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:22,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:22,771 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:22,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e0fbcd0 to 127.0.0.1:62970 2023-07-17 13:12:22,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:22,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 13:12:22,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:22,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:22,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:22,782 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:22,784 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689600142784 2023-07-17 13:12:22,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:22,784 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,785 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:22,786 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:22,787 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:22,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:22,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 12 msec 2023-07-17 13:12:22,790 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:22,791 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689600142791 2023-07-17 13:12:22,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,811 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 13:12:22,812 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:22,813 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 13:12:22,813 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 13:12:22,813 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,813 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,815 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:22,815 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:22,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:22,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:22,815 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:22,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:22,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,815 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,816 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,816 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,816 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,816 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:22,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 13:12:22,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,816 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:22,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 13:12:22,816 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:22,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,816 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,816 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:22,817 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:22,817 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:22,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:22,817 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:22,818 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,818 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:22,818 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:22,819 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:22,818 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:22,820 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:22,820 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:22,820 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:22,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,820 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:22,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-17 13:12:22,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,821 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:22,821 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,821 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:22,821 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:22,822 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:22,822 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:22,822 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:22,822 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,823 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,823 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,823 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:22,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:22,823 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:22,824 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,824 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:22,825 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:22,826 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:22,826 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,826 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:22,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:22,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 13:12:22,828 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d552854[Count = 1] remaining members to acquire global barrier 2023-07-17 13:12:22,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:22,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:22,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:22,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:22,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:22,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 13:12:22,830 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d552854[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:22,830 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 13:12:22,830 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,832 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,832 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,832 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,832 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:22,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,832 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,832 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:22,832 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,832 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:22,832 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,832 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:12:22,832 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:22,832 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:22,832 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:22,833 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,833 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. started... 2023-07-17 13:12:22,833 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:22,833 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:22,832 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:22,833 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba215d4b7eaa183638f71607516f7825: 2023-07-17 13:12:22,833 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:22,833 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:22,833 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. started... 2023-07-17 13:12:22,833 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,833 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:22,835 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:12:22,837 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:22,837 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:22,837 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:22,837 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 796d33079cf86572e77dd3dcee21c2ad: 2023-07-17 13:12:22,839 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,839 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:22,839 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:12:22,859 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. completed. 2023-07-17 13:12:22,859 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:22,859 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:22,859 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:22,859 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,859 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:22,859 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:12:22,862 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:22,862 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,862 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:22,862 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:22,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:22,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:22,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:22,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:22,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,865 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. completed. 2023-07-17 13:12:22,865 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:22,865 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:22,865 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:22,865 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,865 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:22,865 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:12:22,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:22,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,867 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:22,867 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,867 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:22,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,867 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:22,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39513,1689599458171': 2023-07-17 13:12:22,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 13:12:22,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:22,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:22,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:22,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:12:22,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 13:12:22,874 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 13:12:22,874 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:22,874 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:22,874 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,874 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:22,876 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,876 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:22,876 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:22,876 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,876 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,876 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:22,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:22,876 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:22,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:22,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:22,877 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:22,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:22,878 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,878 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:22,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,880 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,880 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,881 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,884 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,884 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,885 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:22,885 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:22,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:22,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:22,886 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:22,891 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:22,891 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:22,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:22,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:22,895 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:22,895 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,895 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,895 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:22,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:22,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:22,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,899 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,899 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:22,900 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:22,900 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:22,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:22,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:22,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:22,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:22,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:22,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:12:22,900 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:22,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:22,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:22,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:22,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:22,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 13:12:22,917 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,940 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,970 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 13:12:22,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,971 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:22,971 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689599542784Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689599542917 (+133 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689599542917Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689599542917Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689599542921 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1689599542934 (+13 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689599542970 (+36 ms) 2023-07-17 13:12:22,975 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:22,977 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 190 msec 2023-07-17 13:12:23,100 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:23,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:23,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:23,105 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39513] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:12:23,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37517] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:12:23,109 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,109 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:23,110 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:23,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:23,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599543123 (current time:1689599543123). 2023-07-17 13:12:23,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:23,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x2d3195b3 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:23,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34b0d1a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:23,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:23,137 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42532, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:23,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d3195b3 to 127.0.0.1:62970 2023-07-17 13:12:23,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:23,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x59a4cd72 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:23,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@789947f8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:23,163 DEBUG [hconnection-0x4a1684be-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:23,166 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:23,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:23,174 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:23,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x59a4cd72 to 127.0.0.1:62970 2023-07-17 13:12:23,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:23,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-17 13:12:23,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:23,177 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:23,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:23,180 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:23,181 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1689600143181 2023-07-17 13:12:23,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-17 13:12:23,183 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:23,183 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:23,184 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-17 13:12:23,184 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:23,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-17 13:12:23,186 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:23,187 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1689600143187 2023-07-17 13:12:23,213 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,213 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-17 13:12:23,213 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:23,215 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-17 13:12:23,215 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-17 13:12:23,216 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,216 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,219 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,219 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,219 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,219 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,221 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,221 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,221 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,223 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 13:12:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 13:12:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,223 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:23,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:23,223 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:23,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:23,223 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-17 13:12:23,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,224 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-17 13:12:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:23,225 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:23,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,226 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,226 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:23,226 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-17 13:12:23,226 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:23,226 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:23,227 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:23,227 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:23,228 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:23,228 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-17 13:12:23,229 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-17 13:12:23,229 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-17 13:12:23,231 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,232 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,232 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:23,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:23,236 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,236 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,236 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:23,236 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,236 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:23,236 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:23,237 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,237 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:23,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:23,238 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 13:12:23,239 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bfbd1f8[Count = 1] remaining members to acquire global barrier 2023-07-17 13:12:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:23,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:23,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-17 13:12:23,243 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bfbd1f8[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:23,243 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-17 13:12:23,243 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,246 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,246 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,246 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,246 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,246 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,247 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:23,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,247 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,247 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:23,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,247 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:23,247 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:23,247 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:12:23,247 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-17 13:12:23,247 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:23,247 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:23,247 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:23,247 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:23,247 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:23,247 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. started... 2023-07-17 13:12:23,247 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:23,247 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. started... 2023-07-17 13:12:23,248 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ba215d4b7eaa183638f71607516f7825 1/1 column families, dataSize=467 B heapSize=1.23 KB 2023-07-17 13:12:23,248 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 796d33079cf86572e77dd3dcee21c2ad 1/1 column families, dataSize=2.80 KB heapSize=6.30 KB 2023-07-17 13:12:23,249 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:23,249 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:23,249 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:23,283 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:23,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:23,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:23,285 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:23,298 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717d44eba5d02704ceab8628191bbbbec33 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230717d44eba5d02704ceab8628191bbbbec33 2023-07-17 13:12:23,328 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230717cb050ea6994440529493b973e3416eac to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230717cb050ea6994440529493b973e3416eac 2023-07-17 13:12:23,355 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=467, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/.tmp/cf/1b4a057581474e4598249c4d110f1dbe 2023-07-17 13:12:23,363 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/.tmp/cf/1b4a057581474e4598249c4d110f1dbe as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/cf/1b4a057581474e4598249c4d110f1dbe 2023-07-17 13:12:23,371 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.8 K, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/.tmp/cf/46d4651261864926a0c593dcabf70cd3 2023-07-17 13:12:23,373 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/cf/1b4a057581474e4598249c4d110f1dbe, entries=7, sequenceid=6, filesize=6.2 K 2023-07-17 13:12:23,374 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~467 B/467, heapSize ~1.22 KB/1248, currentSize=0 B/0 for ba215d4b7eaa183638f71607516f7825 in 126ms, sequenceid=6, compaction requested=false 2023-07-17 13:12:23,374 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-17 13:12:23,375 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ba215d4b7eaa183638f71607516f7825: 2023-07-17 13:12:23,376 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,376 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:23,376 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/cf/1b4a057581474e4598249c4d110f1dbe] hfiles 2023-07-17 13:12:23,376 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/cf/1b4a057581474e4598249c4d110f1dbe for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,377 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/.tmp/cf/46d4651261864926a0c593dcabf70cd3 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/cf/46d4651261864926a0c593dcabf70cd3 2023-07-17 13:12:23,386 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/cf/46d4651261864926a0c593dcabf70cd3, entries=43, sequenceid=6, filesize=12.8 K 2023-07-17 13:12:23,387 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.80 KB/2869, heapSize ~6.28 KB/6432, currentSize=0 B/0 for 796d33079cf86572e77dd3dcee21c2ad in 139ms, sequenceid=6, compaction requested=false 2023-07-17 13:12:23,390 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 796d33079cf86572e77dd3dcee21c2ad: 2023-07-17 13:12:23,390 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,390 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:23,390 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/cf/46d4651261864926a0c593dcabf70cd3] hfiles 2023-07-17 13:12:23,390 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/cf/46d4651261864926a0c593dcabf70cd3 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,397 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. completed. 2023-07-17 13:12:23,397 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:23,397 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:23,397 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:23,397 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,397 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:23,398 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:12:23,409 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. completed. 2023-07-17 13:12:23,409 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:23,409 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:23,409 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:23,409 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,409 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-17 13:12:23,409 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:12:23,415 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,416 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:23,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:23,416 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:23,416 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:23,454 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-17 13:12:23,454 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,454 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:23,454 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-17 13:12:23,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:23,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:23,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:23,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39513,1689599458171': 2023-07-17 13:12:23,462 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-17 13:12:23,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:23,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:23,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:23,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:23,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,465 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:23,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,467 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,468 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:12:23,468 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-17 13:12:23,468 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-17 13:12:23,468 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:23,468 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:23,468 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,468 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:23,485 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:23,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:23,486 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:23,487 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:12:23,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:23,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,593 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,594 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:23,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,594 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,594 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,594 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,595 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,597 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,597 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:23,598 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,616 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,616 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,616 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:23,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,616 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,616 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:23,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:23,618 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,616 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,616 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,616 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,618 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:23,618 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:23,618 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:12:23,618 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,618 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,619 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,619 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:23,619 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,619 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:23,619 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:23,619 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,619 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:23,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:23,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230717cb050ea6994440529493b973e3416eac, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230717d44eba5d02704ceab8628191bbbbec33] mob files 2023-07-17 13:12:23,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230717cb050ea6994440529493b973e3416eac 2023-07-17 13:12:23,620 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230717d44eba5d02704ceab8628191bbbbec33 2023-07-17 13:12:23,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,717 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,777 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-17 13:12:23,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,778 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:23,778 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1689599543182Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1689599543655 (+473 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689599543655Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1689599543655Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1689599543668 (+13 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1689599543700 (+32 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1689599543777 (+77 ms) 2023-07-17 13:12:23,781 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-17 13:12:23,782 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 598 msec 2023-07-17 13:12:23,787 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:23,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-17 13:12:23,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:23,828 DEBUG [Listener at jenkins-hbase4.apache.org/45655] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:12:23,833 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:12:23,835 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32803] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 13:12:23,836 DEBUG [Listener at jenkins-hbase4.apache.org/45655] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:12:23,842 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42552, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:12:23,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37517] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 13:12:23,843 DEBUG [Listener at jenkins-hbase4.apache.org/45655] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-17 13:12:23,846 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46000, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-17 13:12:23,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39513] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-17 13:12:23,849 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-17 13:12:23,852 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:23,855 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:12:23,855 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-17 13:12:23,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:12:23,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 13:12:23,858 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:23,858 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:23,859 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a empty. 2023-07-17 13:12:23,859 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72 empty. 2023-07-17 13:12:23,859 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:23,859 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:23,860 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 13:12:23,880 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-17 13:12:23,882 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6457dc974e2ac7081faf15c0b49ac47a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:12:23,882 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 664e57dd05762944539e0744baa8ce72, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:12:23,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:23,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 6457dc974e2ac7081faf15c0b49ac47a, disabling compactions & flushes 2023-07-17 13:12:23,906 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:23,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:23,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. after waiting 0 ms 2023-07-17 13:12:23,906 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:23,907 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:23,907 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 6457dc974e2ac7081faf15c0b49ac47a: 2023-07-17 13:12:23,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:23,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 664e57dd05762944539e0744baa8ce72, disabling compactions & flushes 2023-07-17 13:12:23,921 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:23,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:23,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. after waiting 0 ms 2023-07-17 13:12:23,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:23,921 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:23,921 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 664e57dd05762944539e0744baa8ce72: 2023-07-17 13:12:23,924 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:12:23,925 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599543925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599543925"}]},"ts":"1689599543925"} 2023-07-17 13:12:23,925 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599543925"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599543925"}]},"ts":"1689599543925"} 2023-07-17 13:12:23,930 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:12:23,932 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:12:23,932 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599543932"}]},"ts":"1689599543932"} 2023-07-17 13:12:23,934 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-17 13:12:23,938 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:12:23,940 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:12:23,940 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:12:23,940 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:12:23,940 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:12:23,940 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6457dc974e2ac7081faf15c0b49ac47a, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=664e57dd05762944539e0744baa8ce72, ASSIGN}] 2023-07-17 13:12:23,943 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=664e57dd05762944539e0744baa8ce72, ASSIGN 2023-07-17 13:12:23,944 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6457dc974e2ac7081faf15c0b49ac47a, ASSIGN 2023-07-17 13:12:23,944 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6457dc974e2ac7081faf15c0b49ac47a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37517,1689599458122; forceNewPlan=false, retain=false 2023-07-17 13:12:23,944 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=664e57dd05762944539e0744baa8ce72, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39513,1689599458171; forceNewPlan=false, retain=false 2023-07-17 13:12:23,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 13:12:24,095 INFO [jenkins-hbase4:42365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:12:24,099 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=664e57dd05762944539e0744baa8ce72, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:24,099 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599544098"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599544098"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599544098"}]},"ts":"1689599544098"} 2023-07-17 13:12:24,099 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6457dc974e2ac7081faf15c0b49ac47a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:24,099 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599544099"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599544099"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599544099"}]},"ts":"1689599544099"} 2023-07-17 13:12:24,101 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure 664e57dd05762944539e0744baa8ce72, server=jenkins-hbase4.apache.org,39513,1689599458171}] 2023-07-17 13:12:24,102 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 6457dc974e2ac7081faf15c0b49ac47a, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:12:24,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 13:12:24,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:24,258 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:24,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6457dc974e2ac7081faf15c0b49ac47a, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a.', STARTKEY => '', ENDKEY => '2'} 2023-07-17 13:12:24,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 664e57dd05762944539e0744baa8ce72, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72.', STARTKEY => '2', ENDKEY => ''} 2023-07-17 13:12:24,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. service=AccessControlService 2023-07-17 13:12:24,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. service=AccessControlService 2023-07-17 13:12:24,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:24,259 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:24,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:24,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:24,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:24,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:24,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:24,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:24,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:24,259 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:24,263 INFO [StoreOpener-6457dc974e2ac7081faf15c0b49ac47a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:24,263 INFO [StoreOpener-664e57dd05762944539e0744baa8ce72-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:24,265 DEBUG [StoreOpener-664e57dd05762944539e0744baa8ce72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/cf 2023-07-17 13:12:24,265 DEBUG [StoreOpener-6457dc974e2ac7081faf15c0b49ac47a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/cf 2023-07-17 13:12:24,265 DEBUG [StoreOpener-664e57dd05762944539e0744baa8ce72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/cf 2023-07-17 13:12:24,265 DEBUG [StoreOpener-6457dc974e2ac7081faf15c0b49ac47a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/cf 2023-07-17 13:12:24,266 INFO [StoreOpener-664e57dd05762944539e0744baa8ce72-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 664e57dd05762944539e0744baa8ce72 columnFamilyName cf 2023-07-17 13:12:24,266 INFO [StoreOpener-6457dc974e2ac7081faf15c0b49ac47a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6457dc974e2ac7081faf15c0b49ac47a columnFamilyName cf 2023-07-17 13:12:24,266 INFO [StoreOpener-6457dc974e2ac7081faf15c0b49ac47a-1] regionserver.HStore(310): Store=6457dc974e2ac7081faf15c0b49ac47a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:24,266 INFO [StoreOpener-664e57dd05762944539e0744baa8ce72-1] regionserver.HStore(310): Store=664e57dd05762944539e0744baa8ce72/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:24,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:24,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:24,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:24,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:24,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:24,274 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:24,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:24,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:24,279 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6457dc974e2ac7081faf15c0b49ac47a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70496733, jitterRate=0.050483182072639465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:24,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6457dc974e2ac7081faf15c0b49ac47a: 2023-07-17 13:12:24,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 664e57dd05762944539e0744baa8ce72; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67871823, jitterRate=0.011368975043296814}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:24,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 664e57dd05762944539e0744baa8ce72: 2023-07-17 13:12:24,280 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a., pid=70, masterSystemTime=1689599544254 2023-07-17 13:12:24,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72., pid=69, masterSystemTime=1689599544254 2023-07-17 13:12:24,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:24,283 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:24,284 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=6457dc974e2ac7081faf15c0b49ac47a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:24,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:24,284 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:24,284 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599544284"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599544284"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599544284"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599544284"}]},"ts":"1689599544284"} 2023-07-17 13:12:24,285 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=664e57dd05762944539e0744baa8ce72, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:24,285 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599544284"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599544284"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599544284"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599544284"}]},"ts":"1689599544284"} 2023-07-17 13:12:24,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-17 13:12:24,288 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 6457dc974e2ac7081faf15c0b49ac47a, server=jenkins-hbase4.apache.org,37517,1689599458122 in 184 msec 2023-07-17 13:12:24,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-17 13:12:24,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure 664e57dd05762944539e0744baa8ce72, server=jenkins-hbase4.apache.org,39513,1689599458171 in 186 msec 2023-07-17 13:12:24,291 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6457dc974e2ac7081faf15c0b49ac47a, ASSIGN in 348 msec 2023-07-17 13:12:24,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-17 13:12:24,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=664e57dd05762944539e0744baa8ce72, ASSIGN in 350 msec 2023-07-17 13:12:24,293 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:12:24,293 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599544293"}]},"ts":"1689599544293"} 2023-07-17 13:12:24,295 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-17 13:12:24,299 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:12:24,300 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-17 13:12:24,302 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 13:12:24,304 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:24,304 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:24,304 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:24,304 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:24,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:24,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:24,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:24,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:24,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:24,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:24,307 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:24,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:24,309 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 457 msec 2023-07-17 13:12:24,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-17 13:12:24,460 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-17 13:12:24,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 6457dc974e2ac7081faf15c0b49ac47a, 664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:24,515 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 13:12:24,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6457dc974e2ac7081faf15c0b49ac47a, 664e57dd05762944539e0744baa8ce72], force=true 2023-07-17 13:12:24,519 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6457dc974e2ac7081faf15c0b49ac47a, 664e57dd05762944539e0744baa8ce72], force=true 2023-07-17 13:12:24,519 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6457dc974e2ac7081faf15c0b49ac47a, 664e57dd05762944539e0744baa8ce72], force=true 2023-07-17 13:12:24,519 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6457dc974e2ac7081faf15c0b49ac47a, 664e57dd05762944539e0744baa8ce72], force=true 2023-07-17 13:12:24,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 13:12:24,552 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6457dc974e2ac7081faf15c0b49ac47a, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=664e57dd05762944539e0744baa8ce72, UNASSIGN}] 2023-07-17 13:12:24,560 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6457dc974e2ac7081faf15c0b49ac47a, UNASSIGN 2023-07-17 13:12:24,560 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=664e57dd05762944539e0744baa8ce72, UNASSIGN 2023-07-17 13:12:24,565 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6457dc974e2ac7081faf15c0b49ac47a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:24,565 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=664e57dd05762944539e0744baa8ce72, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:24,565 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599544565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599544565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599544565"}]},"ts":"1689599544565"} 2023-07-17 13:12:24,565 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599544565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599544565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599544565"}]},"ts":"1689599544565"} 2023-07-17 13:12:24,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 6457dc974e2ac7081faf15c0b49ac47a, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:12:24,569 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 664e57dd05762944539e0744baa8ce72, server=jenkins-hbase4.apache.org,39513,1689599458171}] 2023-07-17 13:12:24,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 13:12:24,721 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:24,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6457dc974e2ac7081faf15c0b49ac47a, disabling compactions & flushes 2023-07-17 13:12:24,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:24,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:24,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. after waiting 0 ms 2023-07-17 13:12:24,723 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:24,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6457dc974e2ac7081faf15c0b49ac47a 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 13:12:24,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:24,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 664e57dd05762944539e0744baa8ce72, disabling compactions & flushes 2023-07-17 13:12:24,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:24,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:24,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. after waiting 0 ms 2023-07-17 13:12:24,726 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:24,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 664e57dd05762944539e0744baa8ce72 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-17 13:12:24,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/.tmp/cf/0943e771bf8548d788f04a883afd0389 2023-07-17 13:12:24,763 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/.tmp/cf/0125f2cd66f544b193d94222ad797fc2 2023-07-17 13:12:24,770 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/.tmp/cf/0943e771bf8548d788f04a883afd0389 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/cf/0943e771bf8548d788f04a883afd0389 2023-07-17 13:12:24,774 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/.tmp/cf/0125f2cd66f544b193d94222ad797fc2 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/cf/0125f2cd66f544b193d94222ad797fc2 2023-07-17 13:12:24,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/cf/0943e771bf8548d788f04a883afd0389, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 13:12:24,778 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 664e57dd05762944539e0744baa8ce72 in 52ms, sequenceid=5, compaction requested=false 2023-07-17 13:12:24,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/cf/0125f2cd66f544b193d94222ad797fc2, entries=1, sequenceid=5, filesize=4.7 K 2023-07-17 13:12:24,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 6457dc974e2ac7081faf15c0b49ac47a in 68ms, sequenceid=5, compaction requested=false 2023-07-17 13:12:24,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 13:12:24,802 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:24,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a. 2023-07-17 13:12:24,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6457dc974e2ac7081faf15c0b49ac47a: 2023-07-17 13:12:24,807 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=6457dc974e2ac7081faf15c0b49ac47a, regionState=CLOSED 2023-07-17 13:12:24,807 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599544807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599544807"}]},"ts":"1689599544807"} 2023-07-17 13:12:24,807 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:24,809 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-17 13:12:24,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:24,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72. 2023-07-17 13:12:24,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 664e57dd05762944539e0744baa8ce72: 2023-07-17 13:12:24,811 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-17 13:12:24,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 6457dc974e2ac7081faf15c0b49ac47a, server=jenkins-hbase4.apache.org,37517,1689599458122 in 241 msec 2023-07-17 13:12:24,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:24,812 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=664e57dd05762944539e0744baa8ce72, regionState=CLOSED 2023-07-17 13:12:24,813 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1689599544812"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599544812"}]},"ts":"1689599544812"} 2023-07-17 13:12:24,813 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6457dc974e2ac7081faf15c0b49ac47a, UNASSIGN in 265 msec 2023-07-17 13:12:24,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-17 13:12:24,817 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 664e57dd05762944539e0744baa8ce72, server=jenkins-hbase4.apache.org,39513,1689599458171 in 245 msec 2023-07-17 13:12:24,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-17 13:12:24,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=664e57dd05762944539e0744baa8ce72, UNASSIGN in 265 msec 2023-07-17 13:12:24,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 13:12:24,914 DEBUG [PEWorker-3] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-17 13:12:24,917 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543848.6457dc974e2ac7081faf15c0b49ac47a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:24,917 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1689599543848.664e57dd05762944539e0744baa8ce72.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:24,917 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:24,974 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fdf52d3c3c002daf1e520979389884f7, ASSIGN}] 2023-07-17 13:12:24,976 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fdf52d3c3c002daf1e520979389884f7, ASSIGN 2023-07-17 13:12:24,977 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fdf52d3c3c002daf1e520979389884f7, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,37517,1689599458122; forceNewPlan=false, retain=false 2023-07-17 13:12:25,127 INFO [jenkins-hbase4:42365] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-17 13:12:25,130 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=fdf52d3c3c002daf1e520979389884f7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,130 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689599545130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599545130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599545130"}]},"ts":"1689599545130"} 2023-07-17 13:12:25,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 13:12:25,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure fdf52d3c3c002daf1e520979389884f7, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:12:25,293 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. 2023-07-17 13:12:25,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fdf52d3c3c002daf1e520979389884f7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.', STARTKEY => '', ENDKEY => ''} 2023-07-17 13:12:25,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. service=AccessControlService 2023-07-17 13:12:25,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:25,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:25,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:25,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:25,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:25,304 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/.regioninfo 2023-07-17 13:12:25,348 INFO [StoreOpener-fdf52d3c3c002daf1e520979389884f7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:25,349 DEBUG [StoreOpener-fdf52d3c3c002daf1e520979389884f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf 2023-07-17 13:12:25,349 DEBUG [StoreOpener-fdf52d3c3c002daf1e520979389884f7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf 2023-07-17 13:12:25,350 INFO [StoreOpener-fdf52d3c3c002daf1e520979389884f7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fdf52d3c3c002daf1e520979389884f7 columnFamilyName cf 2023-07-17 13:12:25,403 DEBUG [StoreOpener-fdf52d3c3c002daf1e520979389884f7-1] regionserver.HStore(539): loaded hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf/0125f2cd66f544b193d94222ad797fc2.6457dc974e2ac7081faf15c0b49ac47a->hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/cf/0125f2cd66f544b193d94222ad797fc2-top 2023-07-17 13:12:25,417 DEBUG [StoreOpener-fdf52d3c3c002daf1e520979389884f7-1] regionserver.HStore(539): loaded hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf/0943e771bf8548d788f04a883afd0389.664e57dd05762944539e0744baa8ce72->hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/cf/0943e771bf8548d788f04a883afd0389-top 2023-07-17 13:12:25,417 INFO [StoreOpener-fdf52d3c3c002daf1e520979389884f7-1] regionserver.HStore(310): Store=fdf52d3c3c002daf1e520979389884f7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:25,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:25,420 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:25,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:25,425 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fdf52d3c3c002daf1e520979389884f7; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74925795, jitterRate=0.11648134887218475}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:25,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fdf52d3c3c002daf1e520979389884f7: 2023-07-17 13:12:25,426 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7., pid=77, masterSystemTime=1689599545288 2023-07-17 13:12:25,427 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.,because compaction is disabled. 2023-07-17 13:12:25,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. 2023-07-17 13:12:25,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. 2023-07-17 13:12:25,429 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=fdf52d3c3c002daf1e520979389884f7, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,430 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689599545429"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599545429"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599545429"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599545429"}]},"ts":"1689599545429"} 2023-07-17 13:12:25,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-17 13:12:25,437 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure fdf52d3c3c002daf1e520979389884f7, server=jenkins-hbase4.apache.org,37517,1689599458122 in 299 msec 2023-07-17 13:12:25,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-17 13:12:25,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fdf52d3c3c002daf1e520979389884f7, ASSIGN in 463 msec 2023-07-17 13:12:25,445 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[6457dc974e2ac7081faf15c0b49ac47a, 664e57dd05762944539e0744baa8ce72], force=true in 932 msec 2023-07-17 13:12:25,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-17 13:12:25,635 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-17 13:12:25,636 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 13:12:25,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599545636 (current time:1689599545636). 2023-07-17 13:12:25,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:25,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x5d71fe8a to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:25,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e671d0d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:25,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:25,673 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42554, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:25,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5d71fe8a to 127.0.0.1:62970 2023-07-17 13:12:25,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:25,675 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x66a3afc9 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:25,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34749839, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:25,696 DEBUG [hconnection-0x32fd74cf-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:25,701 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42568, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:25,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:25,711 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56762, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:25,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66a3afc9 to 127.0.0.1:62970 2023-07-17 13:12:25,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:25,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-17 13:12:25,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:25,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 13:12:25,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 13:12:25,721 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 13:12:25,723 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1689600145723 2023-07-17 13:12:25,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-17 13:12:25,724 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,737 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:25,737 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:25,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 13:12:25,739 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-17 13:12:25,744 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 23 msec 2023-07-17 13:12:25,745 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 13:12:25,746 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1689600145746 2023-07-17 13:12:25,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,791 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-17 13:12:25,791 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:25,793 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-17 13:12:25,793 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-17 13:12:25,820 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,820 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,822 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,822 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:25,822 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:25,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:25,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:25,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:25,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:25,823 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:25,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:25,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:25,823 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,823 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:25,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 13:12:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,824 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 13:12:25,825 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,825 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 13:12:25,825 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:25,827 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 13:12:25,827 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 13:12:25,827 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 13:12:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,829 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,829 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 13:12:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,829 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:25,829 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 13:12:25,829 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,829 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:25,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:25,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-17 13:12:25,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,830 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-17 13:12:25,830 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,830 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 13:12:25,830 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:25,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:25,832 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 13:12:25,832 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 13:12:25,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,832 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 13:12:25,832 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-17 13:12:25,832 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:25,834 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-17 13:12:25,834 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-17 13:12:25,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,834 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-17 13:12:25,837 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:25,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 13:12:25,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:25,838 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:25,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,842 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,844 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,844 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,844 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:25,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:25,844 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,845 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:25,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-17 13:12:25,845 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40737a7b[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:25,845 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-17 13:12:25,845 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,846 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,846 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,846 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,846 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,846 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:25,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,846 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 13:12:25,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 13:12:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 13:12:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-17 13:12:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 13:12:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:12:25,847 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:12:25,849 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 13:12:25,849 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:25,849 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 13:12:25,850 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 13:12:25,850 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:25,850 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 13:12:25,850 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:25,850 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:25,850 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. 2023-07-17 13:12:25,856 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. started... 2023-07-17 13:12:25,857 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fdf52d3c3c002daf1e520979389884f7: 2023-07-17 13:12:25,857 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,857 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:25,858 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf/0125f2cd66f544b193d94222ad797fc2.6457dc974e2ac7081faf15c0b49ac47a->hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/cf/0125f2cd66f544b193d94222ad797fc2-top, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf/0943e771bf8548d788f04a883afd0389.664e57dd05762944539e0744baa8ce72->hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/cf/0943e771bf8548d788f04a883afd0389-top] hfiles 2023-07-17 13:12:25,858 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf/0125f2cd66f544b193d94222ad797fc2.6457dc974e2ac7081faf15c0b49ac47a for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,858 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf/0943e771bf8548d788f04a883afd0389.664e57dd05762944539e0744baa8ce72 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,871 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. completed. 2023-07-17 13:12:25,872 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. 2023-07-17 13:12:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-17 13:12:25,872 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:12:25,880 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,880 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-17 13:12:25,880 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:25,880 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-17 13:12:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:25,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:25,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:25,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:25,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:25,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:25,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:25,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:12:25,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-17 13:12:25,885 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-17 13:12:25,885 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:25,885 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:25,885 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,885 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:25,887 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,887 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,887 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,887 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:25,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:25,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,887 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:25,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,887 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:25,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:25,887 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:25,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:25,888 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:25,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:25,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:25,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:25,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:25,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:25,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,889 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:25,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,891 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:25,892 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:25,893 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,893 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:25,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,895 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:25,895 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:25,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:25,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:25,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:25,896 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:25,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:25,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:25,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:25,896 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:25,897 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:25,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:25,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:25,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:25,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:25,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:25,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:25,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,897 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:25,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:25,898 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:25,898 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-17 13:12:25,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:25,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:25,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:25,945 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:26,028 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-17 13:12:26,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:26,028 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:26,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1689599545724Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689599545897 (+173 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689599545897Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689599545901 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1689599545920 (+19 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1689599546028 (+108 ms) 2023-07-17 13:12:26,032 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-17 13:12:26,033 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 303 msec 2023-07-17 13:12:26,038 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:26,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-17 13:12:26,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:26,040 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599546040 2023-07-17 13:12:26,040 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42441, tgtDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599546040, rawTgtDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599546040, srcFsUri=hdfs://localhost:42441, srcDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:12:26,074 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:12:26,074 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-2142073631_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599546040, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599546040/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:26,074 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295, snapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-17 13:12:26,141 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599546040/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:26,221 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0004_000001 (auth:SIMPLE) 2023-07-17 13:12:26,261 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:26,262 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:26,262 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:26,263 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:27,386 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:12:27,403 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-7323316722732588039.jar 2023-07-17 13:12:27,403 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:27,404 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:27,497 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-8931694733296958617.jar 2023-07-17 13:12:27,498 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:27,500 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:27,501 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:27,501 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:27,505 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:27,505 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:27,506 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:12:27,506 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:12:27,507 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:12:27,507 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:12:27,508 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:12:27,509 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:12:27,509 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:12:27,510 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:12:27,510 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:12:27,511 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:12:27,512 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:27,512 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:27,513 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:27,514 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:27,514 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:27,515 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:27,516 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:28,334 WARN [Listener at jenkins-hbase4.apache.org/45655] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:12:28,337 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-17 13:12:28,340 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-17 13:12:28,459 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:28,461 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:28,844 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0005_000001 (auth:SIMPLE) 2023-07-17 13:12:35,290 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0005_000001 (auth:SIMPLE) 2023-07-17 13:12:37,627 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0005_000001 (auth:SIMPLE) 2023-07-17 13:12:41,626 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0005_000001 (auth:SIMPLE) 2023-07-17 13:12:42,717 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:12:42,721 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:12:42,733 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,734 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:12:42,734 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:12:42,734 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,735 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 13:12:42,735 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 13:12:42,735 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599546040/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599546040/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,735 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599546040/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-17 13:12:42,735 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599546040/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-17 13:12:42,742 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,742 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:42,751 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599562751"}]},"ts":"1689599562751"} 2023-07-17 13:12:42,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 13:12:42,752 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-17 13:12:42,754 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-17 13:12:42,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fdf52d3c3c002daf1e520979389884f7, UNASSIGN}] 2023-07-17 13:12:42,757 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fdf52d3c3c002daf1e520979389884f7, UNASSIGN 2023-07-17 13:12:42,758 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=fdf52d3c3c002daf1e520979389884f7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:42,758 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689599562758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599562758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599562758"}]},"ts":"1689599562758"} 2023-07-17 13:12:42,759 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure fdf52d3c3c002daf1e520979389884f7, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:12:42,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 13:12:42,911 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:42,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fdf52d3c3c002daf1e520979389884f7, disabling compactions & flushes 2023-07-17 13:12:42,912 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. 2023-07-17 13:12:42,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. 2023-07-17 13:12:42,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. after waiting 0 ms 2023-07-17 13:12:42,912 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. 2023-07-17 13:12:42,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-17 13:12:42,932 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:42,933 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7. 2023-07-17 13:12:42,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fdf52d3c3c002daf1e520979389884f7: 2023-07-17 13:12:42,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:42,935 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=fdf52d3c3c002daf1e520979389884f7, regionState=CLOSED 2023-07-17 13:12:42,936 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1689599562935"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599562935"}]},"ts":"1689599562935"} 2023-07-17 13:12:42,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-17 13:12:42,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure fdf52d3c3c002daf1e520979389884f7, server=jenkins-hbase4.apache.org,37517,1689599458122 in 183 msec 2023-07-17 13:12:42,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-17 13:12:42,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=fdf52d3c3c002daf1e520979389884f7, UNASSIGN in 189 msec 2023-07-17 13:12:42,948 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599562948"}]},"ts":"1689599562948"} 2023-07-17 13:12:42,950 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-17 13:12:42,952 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-17 13:12:42,954 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 211 msec 2023-07-17 13:12:43,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-17 13:12:43,054 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-17 13:12:43,055 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,060 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,060 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,062 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,066 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,066 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,067 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,067 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,067 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-17 13:12:43,068 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:43,068 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-17 13:12:43,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-17 13:12:43,069 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:12:43,069 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,069 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,069 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,069 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,069 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:12:43,069 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-17 13:12:43,069 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:12:43,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:43,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:43,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 13:12:43,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:43,071 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:43,073 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:43,073 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:43,074 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/recovered.edits] 2023-07-17 13:12:43,076 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/recovered.edits] 2023-07-17 13:12:43,078 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/recovered.edits] 2023-07-17 13:12:43,084 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf/0125f2cd66f544b193d94222ad797fc2.6457dc974e2ac7081faf15c0b49ac47a to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf/0125f2cd66f544b193d94222ad797fc2.6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:43,084 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/cf/0943e771bf8548d788f04a883afd0389 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/cf/0943e771bf8548d788f04a883afd0389 2023-07-17 13:12:43,086 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf/0943e771bf8548d788f04a883afd0389.664e57dd05762944539e0744baa8ce72 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/cf/0943e771bf8548d788f04a883afd0389.664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:43,086 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/cf/0125f2cd66f544b193d94222ad797fc2 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/cf/0125f2cd66f544b193d94222ad797fc2 2023-07-17 13:12:43,088 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/recovered.edits/8.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72/recovered.edits/8.seqid 2023-07-17 13:12:43,089 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/664e57dd05762944539e0744baa8ce72 2023-07-17 13:12:43,092 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/recovered.edits/8.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a/recovered.edits/8.seqid 2023-07-17 13:12:43,093 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6457dc974e2ac7081faf15c0b49ac47a 2023-07-17 13:12:43,094 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/recovered.edits/12.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7/recovered.edits/12.seqid 2023-07-17 13:12:43,095 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/fdf52d3c3c002daf1e520979389884f7 2023-07-17 13:12:43,095 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-17 13:12:43,101 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,103 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-17 13:12:43,106 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-17 13:12:43,107 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,107 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-17 13:12:43,107 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599563107"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:43,112 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-17 13:12:43,112 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fdf52d3c3c002daf1e520979389884f7, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1689599543849.fdf52d3c3c002daf1e520979389884f7.', STARTKEY => '', ENDKEY => ''}] 2023-07-17 13:12:43,112 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-17 13:12:43,112 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599563112"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:43,118 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-17 13:12:43,120 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,122 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 65 msec 2023-07-17 13:12:43,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-17 13:12:43,172 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-17 13:12:43,174 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,174 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 13:12:43,185 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599563185"}]},"ts":"1689599563185"} 2023-07-17 13:12:43,193 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-17 13:12:43,196 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-17 13:12:43,197 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba215d4b7eaa183638f71607516f7825, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=796d33079cf86572e77dd3dcee21c2ad, UNASSIGN}] 2023-07-17 13:12:43,201 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba215d4b7eaa183638f71607516f7825, UNASSIGN 2023-07-17 13:12:43,201 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=796d33079cf86572e77dd3dcee21c2ad, UNASSIGN 2023-07-17 13:12:43,202 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=796d33079cf86572e77dd3dcee21c2ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:43,202 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ba215d4b7eaa183638f71607516f7825, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:43,202 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599563202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599563202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599563202"}]},"ts":"1689599563202"} 2023-07-17 13:12:43,202 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599563202"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599563202"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599563202"}]},"ts":"1689599563202"} 2023-07-17 13:12:43,204 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 796d33079cf86572e77dd3dcee21c2ad, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:12:43,205 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure ba215d4b7eaa183638f71607516f7825, server=jenkins-hbase4.apache.org,39513,1689599458171}] 2023-07-17 13:12:43,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 13:12:43,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:43,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 796d33079cf86572e77dd3dcee21c2ad, disabling compactions & flushes 2023-07-17 13:12:43,361 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:43,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:43,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. after waiting 0 ms 2023-07-17 13:12:43,361 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:43,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:43,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ba215d4b7eaa183638f71607516f7825, disabling compactions & flushes 2023-07-17 13:12:43,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:43,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:43,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. after waiting 0 ms 2023-07-17 13:12:43,362 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:43,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:43,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:43,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad. 2023-07-17 13:12:43,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 796d33079cf86572e77dd3dcee21c2ad: 2023-07-17 13:12:43,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:43,389 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=796d33079cf86572e77dd3dcee21c2ad, regionState=CLOSED 2023-07-17 13:12:43,389 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599563389"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599563389"}]},"ts":"1689599563389"} 2023-07-17 13:12:43,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:43,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:43,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825. 2023-07-17 13:12:43,393 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ba215d4b7eaa183638f71607516f7825: 2023-07-17 13:12:43,395 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:43,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=86 2023-07-17 13:12:43,396 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=ba215d4b7eaa183638f71607516f7825, regionState=CLOSED 2023-07-17 13:12:43,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 796d33079cf86572e77dd3dcee21c2ad, server=jenkins-hbase4.apache.org,37517,1689599458122 in 188 msec 2023-07-17 13:12:43,396 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1689599563396"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599563396"}]},"ts":"1689599563396"} 2023-07-17 13:12:43,399 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=796d33079cf86572e77dd3dcee21c2ad, UNASSIGN in 199 msec 2023-07-17 13:12:43,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=85 2023-07-17 13:12:43,402 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure ba215d4b7eaa183638f71607516f7825, server=jenkins-hbase4.apache.org,39513,1689599458171 in 193 msec 2023-07-17 13:12:43,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-17 13:12:43,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=ba215d4b7eaa183638f71607516f7825, UNASSIGN in 205 msec 2023-07-17 13:12:43,406 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599563406"}]},"ts":"1689599563406"} 2023-07-17 13:12:43,408 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-17 13:12:43,413 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-17 13:12:43,415 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 239 msec 2023-07-17 13:12:43,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-17 13:12:43,487 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-17 13:12:43,488 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,500 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,502 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,504 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,511 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,511 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,511 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,511 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 13:12:43,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 13:12:43,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 13:12:43,512 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-17 13:12:43,513 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:43,514 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:43,515 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,515 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,517 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/recovered.edits] 2023-07-17 13:12:43,518 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,518 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,518 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,518 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,518 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,518 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:43,520 DEBUG [HFileArchiver-16] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/recovered.edits] 2023-07-17 13:12:43,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 13:12:43,532 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/cf/1b4a057581474e4598249c4d110f1dbe to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/cf/1b4a057581474e4598249c4d110f1dbe 2023-07-17 13:12:43,532 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/cf/46d4651261864926a0c593dcabf70cd3 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/cf/46d4651261864926a0c593dcabf70cd3 2023-07-17 13:12:43,538 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825/recovered.edits/9.seqid 2023-07-17 13:12:43,538 DEBUG [HFileArchiver-16] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad/recovered.edits/9.seqid 2023-07-17 13:12:43,539 DEBUG [HFileArchiver-16] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/796d33079cf86572e77dd3dcee21c2ad 2023-07-17 13:12:43,539 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/ba215d4b7eaa183638f71607516f7825 2023-07-17 13:12:43,539 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-17 13:12:43,540 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-17 13:12:43,544 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-17 13:12:43,551 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230717cb050ea6994440529493b973e3416eac to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230717cb050ea6994440529493b973e3416eac 2023-07-17 13:12:43,553 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230717d44eba5d02704ceab8628191bbbbec33 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230717d44eba5d02704ceab8628191bbbbec33 2023-07-17 13:12:43,554 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-17 13:12:43,562 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,566 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-17 13:12:43,568 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-17 13:12:43,570 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,570 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-17 13:12:43,570 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599563570"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:43,571 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599563570"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:43,573 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:12:43,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ba215d4b7eaa183638f71607516f7825, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1689599542073.ba215d4b7eaa183638f71607516f7825.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 796d33079cf86572e77dd3dcee21c2ad, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1689599542073.796d33079cf86572e77dd3dcee21c2ad.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:12:43,573 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-17 13:12:43,573 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599563573"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:43,574 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-17 13:12:43,583 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,585 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 95 msec 2023-07-17 13:12:43,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-17 13:12:43,625 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-17 13:12:43,641 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 13:12:43,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-17 13:12:43,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-17 13:12:43,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-17 13:12:43,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-17 13:12:43,684 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=757 (was 746) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:55538 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_35462862_1 at /127.0.0.1:41278 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4106 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:41300 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (119954474) connection to jenkins-hbase4.apache.org/172.31.14.131:34485 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:36492 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:55554 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_35462862_1 at /127.0.0.1:55512 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=904 (was 896) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=565 (was 436) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=2277 (was 2543) 2023-07-17 13:12:43,685 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-17 13:12:43,712 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=757, OpenFileDescriptor=904, MaxFileDescriptor=60000, SystemLoadAverage=565, ProcessCount=183, AvailableMemoryMB=2276 2023-07-17 13:12:43,712 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=757 is superior to 500 2023-07-17 13:12:43,714 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 13:12:43,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:43,720 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:12:43,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-17 13:12:43,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 13:12:43,722 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:12:43,725 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:43,725 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:43,726 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9 empty. 2023-07-17 13:12:43,726 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be empty. 2023-07-17 13:12:43,727 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:43,727 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:43,727 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 13:12:43,806 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-17 13:12:43,815 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => c9e9a11ad19cdbc67174efd455fb22e9, NAME => 'testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:12:43,821 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => b9d725788dfd8fc6e097f681e708e3be, NAME => 'testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:12:43,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 13:12:43,875 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:43,875 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing c9e9a11ad19cdbc67174efd455fb22e9, disabling compactions & flushes 2023-07-17 13:12:43,875 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:43,875 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:43,875 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. after waiting 0 ms 2023-07-17 13:12:43,875 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:43,875 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:43,875 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for c9e9a11ad19cdbc67174efd455fb22e9: 2023-07-17 13:12:43,894 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:43,894 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing b9d725788dfd8fc6e097f681e708e3be, disabling compactions & flushes 2023-07-17 13:12:43,894 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:43,894 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:43,894 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. after waiting 0 ms 2023-07-17 13:12:43,894 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:43,894 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:43,895 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for b9d725788dfd8fc6e097f681e708e3be: 2023-07-17 13:12:43,901 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:12:43,902 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599563902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599563902"}]},"ts":"1689599563902"} 2023-07-17 13:12:43,902 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599563902"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599563902"}]},"ts":"1689599563902"} 2023-07-17 13:12:43,904 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:12:43,905 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:12:43,906 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599563905"}]},"ts":"1689599563905"} 2023-07-17 13:12:43,908 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-17 13:12:43,911 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:12:43,913 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:12:43,913 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:12:43,913 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:12:43,913 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:12:43,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c9e9a11ad19cdbc67174efd455fb22e9, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b9d725788dfd8fc6e097f681e708e3be, ASSIGN}] 2023-07-17 13:12:43,919 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b9d725788dfd8fc6e097f681e708e3be, ASSIGN 2023-07-17 13:12:43,919 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c9e9a11ad19cdbc67174efd455fb22e9, ASSIGN 2023-07-17 13:12:43,920 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b9d725788dfd8fc6e097f681e708e3be, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39513,1689599458171; forceNewPlan=false, retain=false 2023-07-17 13:12:43,920 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c9e9a11ad19cdbc67174efd455fb22e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37517,1689599458122; forceNewPlan=false, retain=false 2023-07-17 13:12:44,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 13:12:44,070 INFO [jenkins-hbase4:42365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:12:44,073 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=b9d725788dfd8fc6e097f681e708e3be, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,073 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599564073"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599564073"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599564073"}]},"ts":"1689599564073"} 2023-07-17 13:12:44,074 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c9e9a11ad19cdbc67174efd455fb22e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,074 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599564074"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599564074"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599564074"}]},"ts":"1689599564074"} 2023-07-17 13:12:44,076 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure b9d725788dfd8fc6e097f681e708e3be, server=jenkins-hbase4.apache.org,39513,1689599458171}] 2023-07-17 13:12:44,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure c9e9a11ad19cdbc67174efd455fb22e9, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:12:44,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:44,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b9d725788dfd8fc6e097f681e708e3be, NAME => 'testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:12:44,234 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. service=AccessControlService 2023-07-17 13:12:44,234 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:44,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:44,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:44,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:44,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:44,238 INFO [StoreOpener-b9d725788dfd8fc6e097f681e708e3be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:44,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:44,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9e9a11ad19cdbc67174efd455fb22e9, NAME => 'testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:12:44,239 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. service=AccessControlService 2023-07-17 13:12:44,239 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:44,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:44,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:44,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:44,240 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:44,241 DEBUG [StoreOpener-b9d725788dfd8fc6e097f681e708e3be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/cf 2023-07-17 13:12:44,241 DEBUG [StoreOpener-b9d725788dfd8fc6e097f681e708e3be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/cf 2023-07-17 13:12:44,242 INFO [StoreOpener-b9d725788dfd8fc6e097f681e708e3be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b9d725788dfd8fc6e097f681e708e3be columnFamilyName cf 2023-07-17 13:12:44,244 INFO [StoreOpener-b9d725788dfd8fc6e097f681e708e3be-1] regionserver.HStore(310): Store=b9d725788dfd8fc6e097f681e708e3be/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:44,247 INFO [StoreOpener-c9e9a11ad19cdbc67174efd455fb22e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:44,248 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:44,251 DEBUG [StoreOpener-c9e9a11ad19cdbc67174efd455fb22e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/cf 2023-07-17 13:12:44,251 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:44,251 DEBUG [StoreOpener-c9e9a11ad19cdbc67174efd455fb22e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/cf 2023-07-17 13:12:44,251 INFO [StoreOpener-c9e9a11ad19cdbc67174efd455fb22e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9e9a11ad19cdbc67174efd455fb22e9 columnFamilyName cf 2023-07-17 13:12:44,252 INFO [StoreOpener-c9e9a11ad19cdbc67174efd455fb22e9-1] regionserver.HStore(310): Store=c9e9a11ad19cdbc67174efd455fb22e9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:44,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:44,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:44,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:44,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:44,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:44,264 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:44,264 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b9d725788dfd8fc6e097f681e708e3be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68116122, jitterRate=0.015009313821792603}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:44,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b9d725788dfd8fc6e097f681e708e3be: 2023-07-17 13:12:44,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be., pid=93, masterSystemTime=1689599564229 2023-07-17 13:12:44,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c9e9a11ad19cdbc67174efd455fb22e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60766021, jitterRate=-0.09451572597026825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:44,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c9e9a11ad19cdbc67174efd455fb22e9: 2023-07-17 13:12:44,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9., pid=94, masterSystemTime=1689599564230 2023-07-17 13:12:44,267 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:44,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:44,268 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=b9d725788dfd8fc6e097f681e708e3be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,269 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599564268"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599564268"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599564268"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599564268"}]},"ts":"1689599564268"} 2023-07-17 13:12:44,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:44,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:44,270 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=c9e9a11ad19cdbc67174efd455fb22e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,271 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599564270"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599564270"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599564270"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599564270"}]},"ts":"1689599564270"} 2023-07-17 13:12:44,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-17 13:12:44,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure b9d725788dfd8fc6e097f681e708e3be, server=jenkins-hbase4.apache.org,39513,1689599458171 in 195 msec 2023-07-17 13:12:44,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-17 13:12:44,275 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure c9e9a11ad19cdbc67174efd455fb22e9, server=jenkins-hbase4.apache.org,37517,1689599458122 in 195 msec 2023-07-17 13:12:44,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b9d725788dfd8fc6e097f681e708e3be, ASSIGN in 359 msec 2023-07-17 13:12:44,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-17 13:12:44,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c9e9a11ad19cdbc67174efd455fb22e9, ASSIGN in 361 msec 2023-07-17 13:12:44,278 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:12:44,278 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599564278"}]},"ts":"1689599564278"} 2023-07-17 13:12:44,282 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-17 13:12:44,285 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:12:44,286 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-17 13:12:44,288 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:12:44,289 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:44,289 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:44,289 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:44,289 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:44,291 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:44,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:44,292 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:44,294 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:44,297 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 577 msec 2023-07-17 13:12:44,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-17 13:12:44,356 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-17 13:12:44,358 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:44,358 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:44,360 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:44,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:44,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599564424 (current time:1689599564424). 2023-07-17 13:12:44,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:44,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x5439ce03 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:44,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@493241d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:44,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:44,475 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:44,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5439ce03 to 127.0.0.1:62970 2023-07-17 13:12:44,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:44,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x5bc49df6 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:44,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4117095b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:44,587 DEBUG [hconnection-0x1a70ec68-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:44,592 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43276, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:44,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:44,607 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53834, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:44,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5bc49df6 to 127.0.0.1:62970 2023-07-17 13:12:44,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:44,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:12:44,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:44,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:44,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:44,614 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:44,615 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689600164615 2023-07-17 13:12:44,615 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:44,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:44,618 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:44,618 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:44,619 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:44,620 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:44,623 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-07-17 13:12:44,627 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:44,628 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689600164628 2023-07-17 13:12:44,648 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,648 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-17 13:12:44,648 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:44,650 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 13:12:44,650 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 13:12:44,651 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,651 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,659 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:44,659 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,659 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:44,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:44,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:44,659 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:44,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:44,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:44,659 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,660 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,660 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,660 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:44,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 13:12:44,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 13:12:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:44,661 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:44,661 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:44,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-17 13:12:44,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,662 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:44,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,663 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:44,663 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:44,670 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,672 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,672 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:44,673 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:44,673 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:44,673 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:44,673 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:44,673 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:44,673 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:44,676 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:44,676 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:44,676 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:44,676 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:44,676 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:44,676 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:44,677 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,678 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,679 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,679 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:44,679 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:44,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:44,680 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:44,681 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,680 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,681 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:44,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:44,681 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,681 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:44,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:44,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 13:12:44,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42b78c91[Count = 1] remaining members to acquire global barrier 2023-07-17 13:12:44,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:44,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:44,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 13:12:44,687 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 13:12:44,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42b78c91[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:44,687 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,689 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,689 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,689 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,689 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:44,689 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:44,689 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:44,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,690 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:12:44,690 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:44,690 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:44,689 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,690 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:44,690 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:44,690 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. started... 2023-07-17 13:12:44,690 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,690 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:44,692 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:44,692 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:44,692 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b9d725788dfd8fc6e097f681e708e3be: 2023-07-17 13:12:44,692 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:44,692 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. started... 2023-07-17 13:12:44,692 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,692 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:44,692 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:12:44,692 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c9e9a11ad19cdbc67174efd455fb22e9: 2023-07-17 13:12:44,692 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,692 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:44,692 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:12:44,693 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:44,693 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:44,693 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:44,719 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:44,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:44,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:44,720 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:44,720 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. completed. 2023-07-17 13:12:44,721 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:44,721 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:44,721 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:44,721 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,721 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:44,721 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:12:44,721 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. completed. 2023-07-17 13:12:44,722 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:44,722 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:44,722 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:44,722 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,722 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:44,722 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:12:44,723 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,723 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:44,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:44,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:44,723 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:44,724 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:44,725 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:44,725 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:44,725 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:44,725 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:44,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:44,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:44,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39513,1689599458171': 2023-07-17 13:12:44,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 13:12:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:44,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:12:44,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 13:12:44,733 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 13:12:44,733 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:44,733 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:44,733 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,733 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:44,735 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,735 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,735 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,735 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,735 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:44,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:44,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:44,735 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:44,735 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:44,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:44,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:44,736 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,736 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:44,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:44,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:44,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:44,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:44,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,737 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:44,737 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,739 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:44,739 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,739 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,742 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,742 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:44,742 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:44,742 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:44,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:44,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:44,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:44,742 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,742 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:44,743 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:44,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:44,743 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,743 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:44,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:44,743 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:44,743 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:44,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:44,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:44,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:44,743 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:44,743 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:12:44,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:44,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:44,745 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:44,745 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,745 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:44,745 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:44,745 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,746 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,746 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 13:12:44,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,811 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 13:12:44,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,811 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:44,811 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689599564615Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689599564755 (+140 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689599564755Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1689599564755Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1689599564762 (+7 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1689599564774 (+12 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689599564811 (+37 ms) 2023-07-17 13:12:44,815 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:44,820 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 198 msec 2023-07-17 13:12:44,920 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:44,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:44,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:44,925 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39513] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:12:44,927 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37517] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:12:44,930 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:44,930 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:44,930 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:12:44,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:44,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599564941 (current time:1689599564941). 2023-07-17 13:12:44,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:12:44,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x52bfd0c1 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:44,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fb16552, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:44,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:44,963 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:44,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x52bfd0c1 to 127.0.0.1:62970 2023-07-17 13:12:44,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:44,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x10584ac5 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:12:44,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3ccdb9d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:12:44,976 DEBUG [hconnection-0x7892d0e9-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:44,977 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:44,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:12:44,982 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:12:44,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x10584ac5 to 127.0.0.1:62970 2023-07-17 13:12:44,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:12:44,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-17 13:12:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:12:44,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:44,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:44,987 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:44,988 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1689600164988 2023-07-17 13:12:44,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-17 13:12:44,988 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:44,988 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:12:44,989 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:12:44,991 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-17 13:12:44,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:44,993 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-17 13:12:44,994 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:44,994 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1689600164994 2023-07-17 13:12:45,006 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,006 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-17 13:12:45,006 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:45,008 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-17 13:12:45,008 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-17 13:12:45,009 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,009 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,010 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,010 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,010 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,011 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,011 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,011 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,011 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:12:45,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,011 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 13:12:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 13:12:45,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:45,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,012 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:45,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,012 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,012 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:45,012 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:45,012 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:45,012 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:45,014 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:45,015 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,015 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:45,015 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,015 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:45,015 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:45,015 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:45,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,015 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:45,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,018 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,018 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-17 13:12:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,019 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:45,019 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-17 13:12:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:45,019 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-17 13:12:45,019 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:12:45,023 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-17 13:12:45,023 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-17 13:12:45,023 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-17 13:12:45,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:45,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,032 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,032 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,033 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,033 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:12:45,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:45,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 13:12:45,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76941b1b[Count = 1] remaining members to acquire global barrier 2023-07-17 13:12:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:45,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:45,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-17 13:12:45,037 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76941b1b[Count = 0] remaining members to acquire global barrier 2023-07-17 13:12:45,037 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-17 13:12:45,037 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,047 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,047 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,047 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,047 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:45,047 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:45,047 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:12:45,047 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:45,048 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,048 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:12:45,048 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:45,048 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. started... 2023-07-17 13:12:45,048 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:45,048 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c9e9a11ad19cdbc67174efd455fb22e9 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-17 13:12:45,049 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-17 13:12:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:12:45,049 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:12:45,049 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:45,049 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. started... 2023-07-17 13:12:45,050 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b9d725788dfd8fc6e097f681e708e3be 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-17 13:12:45,085 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717d762937b06a743fd8a25faa423de3ad4 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230717d762937b06a743fd8a25faa423de3ad4 2023-07-17 13:12:45,085 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230717e2fcfeca6be54c1b96b85042b6b46903 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230717e2fcfeca6be54c1b96b85042b6b46903 2023-07-17 13:12:45,089 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:45,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:45,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:45,091 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:12:45,107 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/.tmp/cf/07fb99476bc94af9926555d189412d26 2023-07-17 13:12:45,114 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/.tmp/cf/07fb99476bc94af9926555d189412d26 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/cf/07fb99476bc94af9926555d189412d26 2023-07-17 13:12:45,116 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/.tmp/cf/b57a6b6cc8bc40ef999a8b67beddc5fa 2023-07-17 13:12:45,127 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/cf/07fb99476bc94af9926555d189412d26, entries=47, sequenceid=6, filesize=13.1 K 2023-07-17 13:12:45,129 INFO [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for b9d725788dfd8fc6e097f681e708e3be in 78ms, sequenceid=6, compaction requested=false 2023-07-17 13:12:45,129 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-17 13:12:45,130 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b9d725788dfd8fc6e097f681e708e3be: 2023-07-17 13:12:45,130 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,132 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:45,132 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/.tmp/cf/b57a6b6cc8bc40ef999a8b67beddc5fa as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/cf/b57a6b6cc8bc40ef999a8b67beddc5fa 2023-07-17 13:12:45,132 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/cf/07fb99476bc94af9926555d189412d26] hfiles 2023-07-17 13:12:45,132 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/cf/07fb99476bc94af9926555d189412d26 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,145 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/cf/b57a6b6cc8bc40ef999a8b67beddc5fa, entries=3, sequenceid=6, filesize=5.4 K 2023-07-17 13:12:45,147 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for c9e9a11ad19cdbc67174efd455fb22e9 in 99ms, sequenceid=6, compaction requested=false 2023-07-17 13:12:45,150 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c9e9a11ad19cdbc67174efd455fb22e9: 2023-07-17 13:12:45,150 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,150 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:12:45,150 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/cf/b57a6b6cc8bc40ef999a8b67beddc5fa] hfiles 2023-07-17 13:12:45,150 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/cf/b57a6b6cc8bc40ef999a8b67beddc5fa for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,157 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. completed. 2023-07-17 13:12:45,157 DEBUG [rs(jenkins-hbase4.apache.org,39513,1689599458171)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:45,157 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:45,157 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:45,157 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,157 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:45,157 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:12:45,159 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:45,159 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:45,159 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:45,162 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:45,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:45,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39513,1689599458171': 2023-07-17 13:12:45,169 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-17 13:12:45,177 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. completed. 2023-07-17 13:12:45,177 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:45,177 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:12:45,177 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:12:45,177 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,177 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-17 13:12:45,177 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:12:45,179 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-17 13:12:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:45,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:45,179 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-17 13:12:45,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:45,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:12:45,186 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-17 13:12:45,186 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-17 13:12:45,186 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:12:45,186 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:12:45,186 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,186 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:12:45,192 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,192 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:12:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:12:45,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,194 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:12:45,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,195 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,196 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:12:45,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,198 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:12:45,198 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,198 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:45,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,204 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:12:45,205 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:45,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,204 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:45,207 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,207 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,206 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:12:45,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,206 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:12:45,207 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:12:45,207 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:12:45,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:12:45,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230717e2fcfeca6be54c1b96b85042b6b46903, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230717d762937b06a743fd8a25faa423de3ad4] mob files 2023-07-17 13:12:45,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:12:45,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230717e2fcfeca6be54c1b96b85042b6b46903 2023-07-17 13:12:45,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:12:45,208 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230717d762937b06a743fd8a25faa423de3ad4 2023-07-17 13:12:45,291 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:45,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:45,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:45,293 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:12:45,593 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:45,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:45,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:12:45,595 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-17 13:12:45,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,661 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,687 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-17 13:12:45,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,687 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:45,687 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1689599564988Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1689599565636 (+648 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1689599565636Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1689599565637 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1689599565641 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1689599565655 (+14 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1689599565687 (+32 ms) 2023-07-17 13:12:45,692 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-17 13:12:45,694 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 703 msec 2023-07-17 13:12:46,095 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:12:46,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-17 13:12:46,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:12:46,097 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599566097 2023-07-17 13:12:46,097 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42441, tgtDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599566097, rawTgtDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599566097, srcFsUri=hdfs://localhost:42441, srcDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:12:46,133 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:12:46,133 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1713058708_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599566097, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599566097/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:46,134 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295, snapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-17 13:12:46,144 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599566097/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:46,254 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:46,255 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:46,256 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:46,256 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,408 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-9097585522362472365.jar 2023-07-17 13:12:47,408 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,409 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,492 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-8394359568877536823.jar 2023-07-17 13:12:47,493 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,493 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,494 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,494 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,495 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,495 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:12:47,495 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:12:47,496 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:12:47,496 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:12:47,497 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:12:47,497 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:12:47,498 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:12:47,498 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:12:47,499 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:12:47,499 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:12:47,500 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:12:47,500 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:47,501 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:47,501 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:47,502 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:47,502 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:12:47,502 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:47,503 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:12:47,777 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0005_000001 (auth:SIMPLE) 2023-07-17 13:12:48,664 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:12:48,979 WARN [Listener at jenkins-hbase4.apache.org/45655] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:12:48,982 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-17 13:12:49,061 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:49,061 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:12:49,224 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0006_000001 (auth:SIMPLE) 2023-07-17 13:12:56,004 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0006_000001 (auth:SIMPLE) 2023-07-17 13:12:58,413 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:12:58,414 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:12:58,425 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:58,425 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:12:58,426 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:12:58,426 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:58,427 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 13:12:58,427 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 13:12:58,427 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599566097/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599566097/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:58,427 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599566097/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-17 13:12:58,427 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599566097/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-17 13:12:58,433 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 13:12:58,442 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599578441"}]},"ts":"1689599578441"} 2023-07-17 13:12:58,443 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-17 13:12:58,445 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-17 13:12:58,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c9e9a11ad19cdbc67174efd455fb22e9, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b9d725788dfd8fc6e097f681e708e3be, UNASSIGN}] 2023-07-17 13:12:58,448 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c9e9a11ad19cdbc67174efd455fb22e9, UNASSIGN 2023-07-17 13:12:58,448 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b9d725788dfd8fc6e097f681e708e3be, UNASSIGN 2023-07-17 13:12:58,449 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c9e9a11ad19cdbc67174efd455fb22e9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:58,449 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599578449"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599578449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599578449"}]},"ts":"1689599578449"} 2023-07-17 13:12:58,449 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=b9d725788dfd8fc6e097f681e708e3be, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:12:58,449 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599578449"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599578449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599578449"}]},"ts":"1689599578449"} 2023-07-17 13:12:58,450 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure c9e9a11ad19cdbc67174efd455fb22e9, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:12:58,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure b9d725788dfd8fc6e097f681e708e3be, server=jenkins-hbase4.apache.org,39513,1689599458171}] 2023-07-17 13:12:58,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 13:12:58,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:58,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c9e9a11ad19cdbc67174efd455fb22e9, disabling compactions & flushes 2023-07-17 13:12:58,602 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:58,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:58,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. after waiting 0 ms 2023-07-17 13:12:58,602 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:58,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:58,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b9d725788dfd8fc6e097f681e708e3be, disabling compactions & flushes 2023-07-17 13:12:58,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:58,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:58,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. after waiting 0 ms 2023-07-17 13:12:58,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:58,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:58,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:12:58,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:58,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:12:58,616 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9. 2023-07-17 13:12:58,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be. 2023-07-17 13:12:58,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c9e9a11ad19cdbc67174efd455fb22e9: 2023-07-17 13:12:58,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b9d725788dfd8fc6e097f681e708e3be: 2023-07-17 13:12:58,618 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:58,619 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=c9e9a11ad19cdbc67174efd455fb22e9, regionState=CLOSED 2023-07-17 13:12:58,619 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599578619"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599578619"}]},"ts":"1689599578619"} 2023-07-17 13:12:58,619 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:58,619 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=b9d725788dfd8fc6e097f681e708e3be, regionState=CLOSED 2023-07-17 13:12:58,620 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1689599578619"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599578619"}]},"ts":"1689599578619"} 2023-07-17 13:12:58,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=100 2023-07-17 13:12:58,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=101 2023-07-17 13:12:58,624 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure c9e9a11ad19cdbc67174efd455fb22e9, server=jenkins-hbase4.apache.org,37517,1689599458122 in 170 msec 2023-07-17 13:12:58,624 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure b9d725788dfd8fc6e097f681e708e3be, server=jenkins-hbase4.apache.org,39513,1689599458171 in 171 msec 2023-07-17 13:12:58,625 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c9e9a11ad19cdbc67174efd455fb22e9, UNASSIGN in 178 msec 2023-07-17 13:12:58,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-17 13:12:58,626 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=b9d725788dfd8fc6e097f681e708e3be, UNASSIGN in 178 msec 2023-07-17 13:12:58,626 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599578626"}]},"ts":"1689599578626"} 2023-07-17 13:12:58,627 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-17 13:12:58,629 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-17 13:12:58,630 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 196 msec 2023-07-17 13:12:58,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-17 13:12:58,744 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-17 13:12:58,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,752 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,754 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,755 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,758 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:58,758 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:58,759 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,759 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,759 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,759 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,759 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 13:12:58,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 13:12:58,760 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-17 13:12:58,760 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,761 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,761 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,761 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-17 13:12:58,761 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,761 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,761 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/recovered.edits] 2023-07-17 13:12:58,761 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,761 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-17 13:12:58,761 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/recovered.edits] 2023-07-17 13:12:58,761 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:58,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 13:12:58,765 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/cf/b57a6b6cc8bc40ef999a8b67beddc5fa to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/cf/b57a6b6cc8bc40ef999a8b67beddc5fa 2023-07-17 13:12:58,766 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/cf/07fb99476bc94af9926555d189412d26 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/cf/07fb99476bc94af9926555d189412d26 2023-07-17 13:12:58,770 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be/recovered.edits/9.seqid 2023-07-17 13:12:58,770 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9/recovered.edits/9.seqid 2023-07-17 13:12:58,771 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/b9d725788dfd8fc6e097f681e708e3be 2023-07-17 13:12:58,771 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testEmptyExportFileSystemState/c9e9a11ad19cdbc67174efd455fb22e9 2023-07-17 13:12:58,771 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-17 13:12:58,772 DEBUG [PEWorker-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-17 13:12:58,772 DEBUG [PEWorker-3] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-17 13:12:58,778 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230717e2fcfeca6be54c1b96b85042b6b46903 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230717e2fcfeca6be54c1b96b85042b6b46903 2023-07-17 13:12:58,779 DEBUG [PEWorker-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230717d762937b06a743fd8a25faa423de3ad4 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230717d762937b06a743fd8a25faa423de3ad4 2023-07-17 13:12:58,780 DEBUG [PEWorker-3] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-17 13:12:58,782 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,784 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-17 13:12:58,786 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-17 13:12:58,787 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,787 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-17 13:12:58,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599578787"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:58,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599578787"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:58,789 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:12:58,789 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c9e9a11ad19cdbc67174efd455fb22e9, NAME => 'testtb-testEmptyExportFileSystemState,,1689599563714.c9e9a11ad19cdbc67174efd455fb22e9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b9d725788dfd8fc6e097f681e708e3be, NAME => 'testtb-testEmptyExportFileSystemState,1,1689599563714.b9d725788dfd8fc6e097f681e708e3be.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:12:58,789 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-17 13:12:58,789 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599578789"}]},"ts":"9223372036854775807"} 2023-07-17 13:12:58,791 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-17 13:12:58,792 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-17 13:12:58,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 48 msec 2023-07-17 13:12:58,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-17 13:12:58,864 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-17 13:12:58,875 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-17 13:12:58,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:58,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-17 13:12:58,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-17 13:12:58,915 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758 (was 757) Potentially hanging thread: IPC Client (119954474) connection to jenkins-hbase4.apache.org/172.31.14.131:45655 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:39100 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4794 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:55444 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:50160 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (119954474) connection to jenkins-hbase4.apache.org/172.31.14.131:40809 from appattempt_1689599467166_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: IPC Client (119954474) connection to jenkins-hbase4.apache.org/172.31.14.131:42749 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1072677194_1 at /127.0.0.1:50130 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=927 (was 904) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=705 (was 565) - SystemLoadAverage LEAK? -, ProcessCount=183 (was 183), AvailableMemoryMB=1519 (was 2276) 2023-07-17 13:12:58,915 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-17 13:12:58,944 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=758, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=705, ProcessCount=183, AvailableMemoryMB=1518 2023-07-17 13:12:58,944 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-17 13:12:58,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-17 13:12:58,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:12:58,950 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-17 13:12:58,950 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-17 13:12:58,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 13:12:58,951 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-17 13:12:58,954 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:12:58,954 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366 2023-07-17 13:12:58,955 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc empty. 2023-07-17 13:12:58,955 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366 empty. 2023-07-17 13:12:58,955 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:12:58,955 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366 2023-07-17 13:12:58,955 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 13:12:58,969 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-17 13:12:58,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 69c1b1cc206aa49e1eff87d740e77fdc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:12:58,971 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 325d0ed859b84871408b9e633989b366, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp 2023-07-17 13:12:58,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:58,998 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 69c1b1cc206aa49e1eff87d740e77fdc, disabling compactions & flushes 2023-07-17 13:12:58,998 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:12:58,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:12:58,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. after waiting 0 ms 2023-07-17 13:12:58,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:12:58,999 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:12:58,999 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 69c1b1cc206aa49e1eff87d740e77fdc: 2023-07-17 13:12:59,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 13:12:59,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 13:12:59,399 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:59,399 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 325d0ed859b84871408b9e633989b366, disabling compactions & flushes 2023-07-17 13:12:59,399 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:12:59,399 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:12:59,399 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. after waiting 0 ms 2023-07-17 13:12:59,399 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:12:59,399 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:12:59,399 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 325d0ed859b84871408b9e633989b366: 2023-07-17 13:12:59,402 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-17 13:12:59,403 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599579403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599579403"}]},"ts":"1689599579403"} 2023-07-17 13:12:59,403 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599579403"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599579403"}]},"ts":"1689599579403"} 2023-07-17 13:12:59,405 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-17 13:12:59,406 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-17 13:12:59,406 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599579406"}]},"ts":"1689599579406"} 2023-07-17 13:12:59,407 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-17 13:12:59,411 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-17 13:12:59,412 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-17 13:12:59,413 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-17 13:12:59,413 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-17 13:12:59,413 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-17 13:12:59,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69c1b1cc206aa49e1eff87d740e77fdc, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=325d0ed859b84871408b9e633989b366, ASSIGN}] 2023-07-17 13:12:59,415 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=325d0ed859b84871408b9e633989b366, ASSIGN 2023-07-17 13:12:59,416 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69c1b1cc206aa49e1eff87d740e77fdc, ASSIGN 2023-07-17 13:12:59,416 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=325d0ed859b84871408b9e633989b366, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37517,1689599458122; forceNewPlan=false, retain=false 2023-07-17 13:12:59,416 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69c1b1cc206aa49e1eff87d740e77fdc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,32803,1689599458048; forceNewPlan=false, retain=false 2023-07-17 13:12:59,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 13:12:59,566 INFO [jenkins-hbase4:42365] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-17 13:12:59,570 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=325d0ed859b84871408b9e633989b366, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:59,570 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=69c1b1cc206aa49e1eff87d740e77fdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:59,570 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599579569"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599579569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599579569"}]},"ts":"1689599579569"} 2023-07-17 13:12:59,570 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599579569"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599579569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599579569"}]},"ts":"1689599579569"} 2023-07-17 13:12:59,572 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 325d0ed859b84871408b9e633989b366, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:12:59,573 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 69c1b1cc206aa49e1eff87d740e77fdc, server=jenkins-hbase4.apache.org,32803,1689599458048}] 2023-07-17 13:12:59,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:12:59,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:12:59,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 69c1b1cc206aa49e1eff87d740e77fdc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.', STARTKEY => '', ENDKEY => '1'} 2023-07-17 13:12:59,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 325d0ed859b84871408b9e633989b366, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.', STARTKEY => '1', ENDKEY => ''} 2023-07-17 13:12:59,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. service=AccessControlService 2023-07-17 13:12:59,732 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. service=AccessControlService 2023-07-17 13:12:59,732 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:59,733 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-17 13:12:59,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:12:59,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 325d0ed859b84871408b9e633989b366 2023-07-17 13:12:59,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:59,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:12:59,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:12:59,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-17 13:12:59,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 325d0ed859b84871408b9e633989b366 2023-07-17 13:12:59,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 325d0ed859b84871408b9e633989b366 2023-07-17 13:12:59,734 INFO [StoreOpener-325d0ed859b84871408b9e633989b366-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 325d0ed859b84871408b9e633989b366 2023-07-17 13:12:59,736 DEBUG [StoreOpener-325d0ed859b84871408b9e633989b366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/cf 2023-07-17 13:12:59,736 DEBUG [StoreOpener-325d0ed859b84871408b9e633989b366-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/cf 2023-07-17 13:12:59,736 INFO [StoreOpener-325d0ed859b84871408b9e633989b366-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 325d0ed859b84871408b9e633989b366 columnFamilyName cf 2023-07-17 13:12:59,739 INFO [StoreOpener-325d0ed859b84871408b9e633989b366-1] regionserver.HStore(310): Store=325d0ed859b84871408b9e633989b366/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:59,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366 2023-07-17 13:12:59,740 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366 2023-07-17 13:12:59,741 INFO [StoreOpener-69c1b1cc206aa49e1eff87d740e77fdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:12:59,743 DEBUG [StoreOpener-69c1b1cc206aa49e1eff87d740e77fdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/cf 2023-07-17 13:12:59,743 DEBUG [StoreOpener-69c1b1cc206aa49e1eff87d740e77fdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/cf 2023-07-17 13:12:59,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 325d0ed859b84871408b9e633989b366 2023-07-17 13:12:59,743 INFO [StoreOpener-69c1b1cc206aa49e1eff87d740e77fdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 69c1b1cc206aa49e1eff87d740e77fdc columnFamilyName cf 2023-07-17 13:12:59,745 INFO [StoreOpener-69c1b1cc206aa49e1eff87d740e77fdc-1] regionserver.HStore(310): Store=69c1b1cc206aa49e1eff87d740e77fdc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-17 13:12:59,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:12:59,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:59,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:12:59,746 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 325d0ed859b84871408b9e633989b366; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69032583, jitterRate=0.02866564691066742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:59,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 325d0ed859b84871408b9e633989b366: 2023-07-17 13:12:59,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366., pid=108, masterSystemTime=1689599579724 2023-07-17 13:12:59,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:12:59,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:12:59,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:12:59,751 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=325d0ed859b84871408b9e633989b366, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:12:59,751 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599579751"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599579751"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599579751"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599579751"}]},"ts":"1689599579751"} 2023-07-17 13:12:59,755 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-17 13:12:59,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-17 13:12:59,756 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 325d0ed859b84871408b9e633989b366, server=jenkins-hbase4.apache.org,37517,1689599458122 in 181 msec 2023-07-17 13:12:59,756 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 69c1b1cc206aa49e1eff87d740e77fdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59488462, jitterRate=-0.11355283856391907}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-17 13:12:59,756 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 69c1b1cc206aa49e1eff87d740e77fdc: 2023-07-17 13:12:59,757 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc., pid=109, masterSystemTime=1689599579724 2023-07-17 13:12:59,757 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=325d0ed859b84871408b9e633989b366, ASSIGN in 343 msec 2023-07-17 13:12:59,759 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:12:59,759 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:12:59,759 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=69c1b1cc206aa49e1eff87d740e77fdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:12:59,759 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599579759"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1689599579759"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1689599579759"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1689599579759"}]},"ts":"1689599579759"} 2023-07-17 13:12:59,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-17 13:12:59,763 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 69c1b1cc206aa49e1eff87d740e77fdc, server=jenkins-hbase4.apache.org,32803,1689599458048 in 188 msec 2023-07-17 13:12:59,765 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-17 13:12:59,765 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69c1b1cc206aa49e1eff87d740e77fdc, ASSIGN in 350 msec 2023-07-17 13:12:59,766 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-17 13:12:59,766 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599579766"}]},"ts":"1689599579766"} 2023-07-17 13:12:59,768 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-17 13:12:59,775 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-17 13:12:59,775 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-17 13:12:59,777 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 13:12:59,779 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:59,779 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:59,779 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:59,780 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:12:59,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:59,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:59,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:59,781 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-17 13:12:59,787 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 835 msec 2023-07-17 13:13:00,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-17 13:13:00,057 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-17 13:13:00,059 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,059 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:13:00,061 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:13:00,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:13:00,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599580075 (current time:1689599580075). 2023-07-17 13:13:00,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:13:00,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x03c003d4 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:13:00,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2a4ed710, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:13:00,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:13:00,091 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51808, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:13:00,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x03c003d4 to 127.0.0.1:62970 2023-07-17 13:13:00,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:00,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x18c6ff42 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:13:00,101 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1b1b812d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:13:00,102 DEBUG [hconnection-0x47b12309-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:13:00,105 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:13:00,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:13:00,112 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50836, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:13:00,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18c6ff42 to 127.0.0.1:62970 2023-07-17 13:13:00,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:00,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 13:13:00,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:13:00,114 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:13:00,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:13:00,117 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:13:00,118 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689600180118 2023-07-17 13:13:00,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:13:00,118 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,119 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:13:00,120 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:13:00,121 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:13:00,121 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:13:00,122 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-17 13:13:00,123 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:13:00,123 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689600180123 2023-07-17 13:13:00,131 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,131 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 13:13:00,132 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:13:00,133 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 13:13:00,133 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 13:13:00,133 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,133 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,135 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,135 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,135 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,135 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,135 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,135 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,136 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,136 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:13:00,136 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:13:00,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,139 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:13:00,139 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,139 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,139 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:13:00,139 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:13:00,139 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:13:00,139 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:13:00,139 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:13:00,141 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:13:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:13:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:13:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:13:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:13:00,140 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:13:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:13:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:13:00,142 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:13:00,149 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,149 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,149 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,149 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,149 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,149 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,150 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:13:00,149 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,149 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:13:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,150 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,150 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:13:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 13:13:00,152 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73e57020[Count = 1] remaining members to acquire global barrier 2023-07-17 13:13:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 13:13:00,153 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73e57020[Count = 0] remaining members to acquire global barrier 2023-07-17 13:13:00,153 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 13:13:00,153 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,155 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,155 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,155 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:13:00,155 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:13:00,155 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,155 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:13:00,155 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:13:00,155 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,155 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,155 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:13:00,155 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,156 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:13:00,157 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:13:00,157 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:13:00,157 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:13:00,157 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:13:00,157 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. started... 2023-07-17 13:13:00,157 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:13:00,157 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:13:00,157 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. started... 2023-07-17 13:13:00,159 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 325d0ed859b84871408b9e633989b366: 2023-07-17 13:13:00,159 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69c1b1cc206aa49e1eff87d740e77fdc: 2023-07-17 13:13:00,159 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:13:00,159 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,159 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:13:00,159 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:13:00,159 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,159 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:13:00,159 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:13:00,159 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:13:00,159 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-17 13:13:00,186 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. completed. 2023-07-17 13:13:00,186 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:13:00,186 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:13:00,186 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:13:00,186 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. completed. 2023-07-17 13:13:00,186 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,186 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:13:00,186 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:13:00,186 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:13:00,186 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:13:00,186 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:13:00,186 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,186 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:13:00,187 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:13:00,188 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,188 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:13:00,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,188 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:13:00,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,188 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:13:00,189 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:13:00,189 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:13:00,189 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:13:00,189 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:13:00,193 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 13:13:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,32803,1689599458048': 2023-07-17 13:13:00,198 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 13:13:00,198 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 13:13:00,198 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:13:00,198 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:13:00,198 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,198 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:13:00,200 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,200 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,200 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,200 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,201 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,201 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,201 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,203 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,203 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,203 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,209 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,209 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,209 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,209 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,209 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,209 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,210 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,210 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,210 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,210 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,210 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:13:00,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,209 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,211 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,210 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,211 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:13:00,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,211 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,212 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,212 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,212 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,212 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,212 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-17 13:13:00,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,212 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,212 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,220 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:13:00,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:13:00,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:13:00,221 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:13:00,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,266 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 13:13:00,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,267 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,267 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689599580118Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689599580222 (+104 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689599580222Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689599580222Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689599580225 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1689599580236 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689599580266 (+30 ms) 2023-07-17 13:13:00,270 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:13:00,271 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 151 msec 2023-07-17 13:13:00,421 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:13:00,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:13:00,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:13:00,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=32803] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:13:00,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37517] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. with WAL disabled. Data may be lost in the event of a crash. 2023-07-17 13:13:00,436 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,436 DEBUG [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:13:00,436 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-17 13:13:00,450 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:13:00,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1689599580450 (current time:1689599580450). 2023-07-17 13:13:00,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-17 13:13:00,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x722d1d63 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:13:00,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c4ac144, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:13:00,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:13:00,504 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42452, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:13:00,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x722d1d63 to 127.0.0.1:62970 2023-07-17 13:13:00,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:00,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(139): Connect 0x0d6f0d81 to 127.0.0.1:62970 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-17 13:13:00,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1733df4a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-17 13:13:00,580 DEBUG [hconnection-0x7d197c09-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:13:00,583 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42464, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:13:00,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-17 13:13:00,589 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-17 13:13:00,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0d6f0d81 to 127.0.0.1:62970 2023-07-17 13:13:00,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:00,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-17 13:13:00,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-17 13:13:00,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:13:00,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:13:00,594 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:13:00,594 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1689600180594 2023-07-17 13:13:00,594 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-17 13:13:00,596 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-17 13:13:00,596 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-17 13:13:00,596 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:13:00,597 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-17 13:13:00,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-07-17 13:13:00,599 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:13:00,599 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1689600180599 2023-07-17 13:13:00,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,608 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-17 13:13:00,608 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:13:00,609 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-17 13:13:00,609 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-17 13:13:00,616 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,616 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,647 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,647 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,647 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,647 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:00,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:00,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:00,647 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,648 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,648 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,648 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-17 13:13:00,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 13:13:00,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 13:13:00,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-17 13:13:00,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:13:00,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:13:00,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-17 13:13:00,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:13:00,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:13:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:13:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:13:00,649 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,649 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-17 13:13:00,651 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:13:00,651 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:13:00,651 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:13:00,651 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:13:00,651 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-17 13:13:00,651 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:13:00,652 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-17 13:13:00,653 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-17 13:13:00,652 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:13:00,653 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39513,1689599458171' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-17 13:13:00,678 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,678 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,696 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:13:00,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:13:00,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:13:00,697 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-17 13:13:00,701 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,701 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,701 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:13:00,701 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,739 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,739 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,739 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:13:00,740 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,740 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-17 13:13:00,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,741 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,32803,1689599458048' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 13:13:00,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@281e7c85[Count = 1] remaining members to acquire global barrier 2023-07-17 13:13:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,37517,1689599458122' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-17 13:13:00,744 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@281e7c85[Count = 0] remaining members to acquire global barrier 2023-07-17 13:13:00,744 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-17 13:13:00,744 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,823 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-17 13:13:00,862 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,863 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,863 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,863 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:13:00,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,863 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,863 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:13:00,863 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-17 13:13:00,863 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:13:00,863 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39513,1689599458171' in zk 2023-07-17 13:13:00,864 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,864 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-17 13:13:00,864 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:13:00,864 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:13:00,864 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:13:00,865 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:13:00,865 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. started... 2023-07-17 13:13:00,864 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-17 13:13:00,865 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-17 13:13:00,865 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. started... 2023-07-17 13:13:00,865 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 69c1b1cc206aa49e1eff87d740e77fdc 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-17 13:13:00,865 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 325d0ed859b84871408b9e633989b366 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-17 13:13:00,898 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:13:00,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:13:00,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-17 13:13:00,899 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-17 13:13:00,908 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230717aaf915cadaaf49b38d96b5dec5cbcdd3 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230717aaf915cadaaf49b38d96b5dec5cbcdd3 2023-07-17 13:13:00,911 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023071788e6f44314ae43a68e5a83c2b8c2742a to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071788e6f44314ae43a68e5a83c2b8c2742a 2023-07-17 13:13:00,927 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/.tmp/cf/4cb534c7702e44f78859832b6ac00ed6 2023-07-17 13:13:00,932 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:13:00,932 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:13:00,932 DEBUG [member: 'jenkins-hbase4.apache.org,39513,1689599458171' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:13:00,933 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/.tmp/cf/4cb534c7702e44f78859832b6ac00ed6 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/cf/4cb534c7702e44f78859832b6ac00ed6 2023-07-17 13:13:00,939 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/cf/4cb534c7702e44f78859832b6ac00ed6, entries=4, sequenceid=6, filesize=5.6 K 2023-07-17 13:13:00,940 INFO [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 69c1b1cc206aa49e1eff87d740e77fdc in 75ms, sequenceid=6, compaction requested=false 2023-07-17 13:13:00,944 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 69c1b1cc206aa49e1eff87d740e77fdc: 2023-07-17 13:13:00,944 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,945 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:13:00,945 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/cf/4cb534c7702e44f78859832b6ac00ed6] hfiles 2023-07-17 13:13:00,945 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/cf/4cb534c7702e44f78859832b6ac00ed6 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,948 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/.tmp/cf/ffb962bbfb944974a5e7252a753795d2 2023-07-17 13:13:00,956 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/.tmp/cf/ffb962bbfb944974a5e7252a753795d2 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/cf/ffb962bbfb944974a5e7252a753795d2 2023-07-17 13:13:00,956 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. completed. 2023-07-17 13:13:00,956 DEBUG [rs(jenkins-hbase4.apache.org,32803,1689599458048)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:13:00,957 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:13:00,957 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:13:00,957 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,957 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:13:00,957 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,32803,1689599458048' in zk 2023-07-17 13:13:00,959 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:13:00,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:13:00,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,959 DEBUG [member: 'jenkins-hbase4.apache.org,32803,1689599458048' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:13:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,961 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,964 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,965 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/cf/ffb962bbfb944974a5e7252a753795d2, entries=46, sequenceid=6, filesize=13.2 K 2023-07-17 13:13:00,965 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,32803,1689599458048': 2023-07-17 13:13:00,965 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,32803,1689599458048' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-17 13:13:00,966 INFO [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 325d0ed859b84871408b9e633989b366 in 101ms, sequenceid=6, compaction requested=false 2023-07-17 13:13:00,966 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 325d0ed859b84871408b9e633989b366: 2023-07-17 13:13:00,966 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,966 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-17 13:13:00,966 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/cf/ffb962bbfb944974a5e7252a753795d2] hfiles 2023-07-17 13:13:00,966 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/cf/ffb962bbfb944974a5e7252a753795d2 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,977 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. completed. 2023-07-17 13:13:00,978 DEBUG [rs(jenkins-hbase4.apache.org,37517,1689599458122)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:13:00,978 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-17 13:13:00,978 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-17 13:13:00,978 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,978 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-17 13:13:00,978 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,37517,1689599458122' in zk 2023-07-17 13:13:00,980 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,980 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-17 13:13:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,980 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:13:00,980 DEBUG [member: 'jenkins-hbase4.apache.org,37517,1689599458122' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-17 13:13:00,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,37517,1689599458122': 2023-07-17 13:13:00,986 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,37517,1689599458122' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-17 13:13:00,986 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-17 13:13:00,986 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-17 13:13:00,986 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-17 13:13:00,986 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,986 INFO [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-17 13:13:00,988 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,988 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,988 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,988 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,988 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,988 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,988 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,989 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:00,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-17 13:13:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-17 13:13:00,989 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:00,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,991 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-17 13:13:00,991 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,992 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-17 13:13:00,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-17 13:13:00,997 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:00,998 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:00,998 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:00,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:00,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:01,005 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:01,005 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:01,005 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:01,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:01,006 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:01,006 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:01,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:01,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:01,006 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-17 13:13:01,005 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:01,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-17 13:13:01,006 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,007 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,005 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-17 13:13:01,006 DEBUG [(jenkins-hbase4.apache.org,42365,1689599456474)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-17 13:13:01,006 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:01,009 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:01,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:01,006 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-17 13:13:01,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:01,007 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-17 13:13:01,007 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:01,009 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:01,009 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,009 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:01,009 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,010 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:01,010 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:01,010 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,010 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-17 13:13:01,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-17 13:13:01,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071788e6f44314ae43a68e5a83c2b8c2742a, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230717aaf915cadaaf49b38d96b5dec5cbcdd3] mob files 2023-07-17 13:13:01,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071788e6f44314ae43a68e5a83c2b8c2742a 2023-07-17 13:13:01,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230717aaf915cadaaf49b38d96b5dec5cbcdd3 2023-07-17 13:13:01,027 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,028 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,072 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,123 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-17 13:13:01,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,124 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,124 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1689599580594Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1689599581027 (+433 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689599581027Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1689599581027Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1689599581043 (+16 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1689599581063 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1689599581123 (+60 ms) 2023-07-17 13:13:01,127 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-17 13:13:01,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 532 msec 2023-07-17 13:13:01,199 DEBUG [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-17 13:13:01,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-17 13:13:01,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-17 13:13:01,201 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599581201 2023-07-17 13:13:01,201 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:42441, tgtDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599581201, rawTgtDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599581201, srcFsUri=hdfs://localhost:42441, srcDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:13:01,229 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295 2023-07-17 13:13:01,229 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1560752844_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599581201, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599581201/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,229 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:42441, inputRoot=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295, snapshotDir=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-17 13:13:01,245 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599581201/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:01,301 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:01,302 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:01,302 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:01,302 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,383 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-3054973017688215856.jar 2023-07-17 13:13:02,384 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,385 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,469 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/hadoop-1525810101424609831.jar 2023-07-17 13:13:02,470 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,470 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,471 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,471 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,472 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,472 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-17 13:13:02,472 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-17 13:13:02,473 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-17 13:13:02,473 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-17 13:13:02,473 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-17 13:13:02,474 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-17 13:13:02,474 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-17 13:13:02,475 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-17 13:13:02,475 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-17 13:13:02,476 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-17 13:13:02,476 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-17 13:13:02,477 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:13:02,478 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:13:02,478 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:13:02,479 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:13:02,479 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-17 13:13:02,479 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:13:02,480 DEBUG [Listener at jenkins-hbase4.apache.org/45655] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-17 13:13:03,440 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0006_000001 (auth:SIMPLE) 2023-07-17 13:13:03,886 WARN [Listener at jenkins-hbase4.apache.org/45655] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-17 13:13:03,888 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-17 13:13:03,890 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-17 13:13:04,062 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:13:04,062 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-17 13:13:04,294 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:13:04,453 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0007_000001 (auth:SIMPLE) 2023-07-17 13:13:11,331 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0007_000001 (auth:SIMPLE) 2023-07-17 13:13:13,616 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0007_000001 (auth:SIMPLE) 2023-07-17 13:13:17,963 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1689599467166_0007_000001 (auth:SIMPLE) 2023-07-17 13:13:19,224 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-17 13:13:19,224 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-17 13:13:19,237 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,237 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-17 13:13:19,238 INFO [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-17 13:13:19,238 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,238 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 13:13:19,238 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 13:13:19,238 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_943310029_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599581201/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599581201/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,239 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599581201/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-17 13:13:19,239 DEBUG [Listener at jenkins-hbase4.apache.org/45655] snapshot.TestExportSnapshot(367): hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/export-test/export-1689599581201/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-17 13:13:19,245 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,246 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 13:13:19,250 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599599250"}]},"ts":"1689599599250"} 2023-07-17 13:13:19,252 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-17 13:13:19,253 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-17 13:13:19,254 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69c1b1cc206aa49e1eff87d740e77fdc, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=325d0ed859b84871408b9e633989b366, UNASSIGN}] 2023-07-17 13:13:19,256 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69c1b1cc206aa49e1eff87d740e77fdc, UNASSIGN 2023-07-17 13:13:19,256 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=325d0ed859b84871408b9e633989b366, UNASSIGN 2023-07-17 13:13:19,257 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=69c1b1cc206aa49e1eff87d740e77fdc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:19,257 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=325d0ed859b84871408b9e633989b366, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:19,257 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599599257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599599257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599599257"}]},"ts":"1689599599257"} 2023-07-17 13:13:19,257 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599599257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1689599599257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1689599599257"}]},"ts":"1689599599257"} 2023-07-17 13:13:19,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure 325d0ed859b84871408b9e633989b366, server=jenkins-hbase4.apache.org,37517,1689599458122}] 2023-07-17 13:13:19,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 69c1b1cc206aa49e1eff87d740e77fdc, server=jenkins-hbase4.apache.org,32803,1689599458048}] 2023-07-17 13:13:19,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 13:13:19,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 325d0ed859b84871408b9e633989b366 2023-07-17 13:13:19,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 325d0ed859b84871408b9e633989b366, disabling compactions & flushes 2023-07-17 13:13:19,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:13:19,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:13:19,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. after waiting 0 ms 2023-07-17 13:13:19,411 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:13:19,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:13:19,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 69c1b1cc206aa49e1eff87d740e77fdc, disabling compactions & flushes 2023-07-17 13:13:19,412 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:13:19,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:13:19,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. after waiting 0 ms 2023-07-17 13:13:19,412 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:13:19,440 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:13:19,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:19,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc. 2023-07-17 13:13:19,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:13:19,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 69c1b1cc206aa49e1eff87d740e77fdc: 2023-07-17 13:13:19,443 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:19,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366. 2023-07-17 13:13:19,444 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 325d0ed859b84871408b9e633989b366: 2023-07-17 13:13:19,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:13:19,446 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=69c1b1cc206aa49e1eff87d740e77fdc, regionState=CLOSED 2023-07-17 13:13:19,447 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599599446"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599599446"}]},"ts":"1689599599446"} 2023-07-17 13:13:19,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 325d0ed859b84871408b9e633989b366 2023-07-17 13:13:19,447 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=325d0ed859b84871408b9e633989b366, regionState=CLOSED 2023-07-17 13:13:19,447 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1689599599447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1689599599447"}]},"ts":"1689599599447"} 2023-07-17 13:13:19,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-17 13:13:19,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 69c1b1cc206aa49e1eff87d740e77fdc, server=jenkins-hbase4.apache.org,32803,1689599458048 in 190 msec 2023-07-17 13:13:19,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-17 13:13:19,452 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure 325d0ed859b84871408b9e633989b366, server=jenkins-hbase4.apache.org,37517,1689599458122 in 191 msec 2023-07-17 13:13:19,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=69c1b1cc206aa49e1eff87d740e77fdc, UNASSIGN in 197 msec 2023-07-17 13:13:19,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-17 13:13:19,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=325d0ed859b84871408b9e633989b366, UNASSIGN in 198 msec 2023-07-17 13:13:19,454 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1689599599454"}]},"ts":"1689599599454"} 2023-07-17 13:13:19,455 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-17 13:13:19,457 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-17 13:13:19,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 212 msec 2023-07-17 13:13:19,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-17 13:13:19,553 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-17 13:13:19,553 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,559 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,562 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,562 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=32803] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,566 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,566 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,566 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,567 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 13:13:19,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 13:13:19,567 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 13:13:19,568 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-17 13:13:19,569 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,569 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,569 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,569 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,569 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:13:19,569 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:13:19,569 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:13:19,569 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-17 13:13:19,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 13:13:19,587 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:13:19,591 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366 2023-07-17 13:13:19,593 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/recovered.edits] 2023-07-17 13:13:19,594 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/cf, FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/recovered.edits] 2023-07-17 13:13:19,608 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/cf/ffb962bbfb944974a5e7252a753795d2 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/cf/ffb962bbfb944974a5e7252a753795d2 2023-07-17 13:13:19,610 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/cf/4cb534c7702e44f78859832b6ac00ed6 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/cf/4cb534c7702e44f78859832b6ac00ed6 2023-07-17 13:13:19,611 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366/recovered.edits/9.seqid 2023-07-17 13:13:19,612 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/325d0ed859b84871408b9e633989b366 2023-07-17 13:13:19,619 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/recovered.edits/9.seqid to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc/recovered.edits/9.seqid 2023-07-17 13:13:19,619 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/69c1b1cc206aa49e1eff87d740e77fdc 2023-07-17 13:13:19,620 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-17 13:13:19,620 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-17 13:13:19,621 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-17 13:13:19,624 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071788e6f44314ae43a68e5a83c2b8c2742a to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023071788e6f44314ae43a68e5a83c2b8c2742a 2023-07-17 13:13:19,626 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230717aaf915cadaaf49b38d96b5dec5cbcdd3 to hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230717aaf915cadaaf49b38d96b5dec5cbcdd3 2023-07-17 13:13:19,627 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-17 13:13:19,629 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,631 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-17 13:13:19,636 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-17 13:13:19,637 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,637 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-17 13:13:19,637 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599599637"}]},"ts":"9223372036854775807"} 2023-07-17 13:13:19,637 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1689599599637"}]},"ts":"9223372036854775807"} 2023-07-17 13:13:19,639 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-17 13:13:19,639 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 69c1b1cc206aa49e1eff87d740e77fdc, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1689599578945.69c1b1cc206aa49e1eff87d740e77fdc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 325d0ed859b84871408b9e633989b366, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1689599578945.325d0ed859b84871408b9e633989b366.', STARTKEY => '1', ENDKEY => ''}] 2023-07-17 13:13:19,639 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-17 13:13:19,640 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1689599599640"}]},"ts":"9223372036854775807"} 2023-07-17 13:13:19,641 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-17 13:13:19,648 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,650 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 94 msec 2023-07-17 13:13:19,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-17 13:13:19,672 INFO [Listener at jenkins-hbase4.apache.org/45655] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-17 13:13:19,681 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 13:13:19,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-17 13:13:19,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42365] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-17 13:13:19,721 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=761 (was 758) Potentially hanging thread: Thread-5435 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1641649739_1 at /127.0.0.1:59996 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:58814 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:50732 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (119954474) connection to jenkins-hbase4.apache.org/172.31.14.131:39237 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_943310029_17 at /127.0.0.1:60022 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x25a025a3-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=901 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=750 (was 705) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 183), AvailableMemoryMB=1789 (was 1518) - AvailableMemoryMB LEAK? - 2023-07-17 13:13:19,721 WARN [Listener at jenkins-hbase4.apache.org/45655] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-17 13:13:19,721 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-17 13:13:19,735 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 13:13:19,861 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1689599467166_0007_01_000001 is : 143 2023-07-17 13:13:25,021 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-17 13:13:33,890 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 13:13:48,011 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 13:13:48,011 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 13:13:48,121 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-17 13:13:48,135 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-17 13:13:48,137 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 13:13:48,162 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-17 13:13:48,266 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-17 13:13:48,266 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-17 13:13:48,266 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-17 13:13:48,266 INFO [Listener at jenkins-hbase4.apache.org/45655] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-17 13:13:48,266 DEBUG [Listener at jenkins-hbase4.apache.org/45655] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x163e546e to 127.0.0.1:62970 2023-07-17 13:13:48,267 DEBUG [Listener at jenkins-hbase4.apache.org/45655] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:48,267 DEBUG [Listener at jenkins-hbase4.apache.org/45655] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-17 13:13:48,267 DEBUG [Listener at jenkins-hbase4.apache.org/45655] util.JVMClusterUtil(257): Found active master hash=729524139, stopped=false 2023-07-17 13:13:48,267 DEBUG [Listener at jenkins-hbase4.apache.org/45655] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:48,267 DEBUG [Listener at jenkins-hbase4.apache.org/45655] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-17 13:13:48,267 INFO [Listener at jenkins-hbase4.apache.org/45655] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42365,1689599456474 2023-07-17 13:13:48,291 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 13:13:48,291 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 13:13:48,291 INFO [Listener at jenkins-hbase4.apache.org/45655] procedure2.ProcedureExecutor(629): Stopping 2023-07-17 13:13:48,291 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 13:13:48,291 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:13:48,291 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-17 13:13:48,291 DEBUG [Listener at jenkins-hbase4.apache.org/45655] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x65ac29dd to 127.0.0.1:62970 2023-07-17 13:13:48,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:13:48,291 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:13:48,291 DEBUG [Listener at jenkins-hbase4.apache.org/45655] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:48,292 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:13:48,292 INFO [Listener at jenkins-hbase4.apache.org/45655] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,32803,1689599458048' ***** 2023-07-17 13:13:48,292 DEBUG [Listener at jenkins-hbase4.apache.org/45655] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:48,292 INFO [Listener at jenkins-hbase4.apache.org/45655] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 13:13:48,292 INFO [Listener at jenkins-hbase4.apache.org/45655] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,37517,1689599458122' ***** 2023-07-17 13:13:48,292 DEBUG [Listener at jenkins-hbase4.apache.org/45655] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:48,292 INFO [Listener at jenkins-hbase4.apache.org/45655] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 13:13:48,292 INFO [RS:0;jenkins-hbase4:32803] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 13:13:48,292 INFO [Listener at jenkins-hbase4.apache.org/45655] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39513,1689599458171' ***** 2023-07-17 13:13:48,293 INFO [RS:1;jenkins-hbase4:37517] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 13:13:48,293 INFO [RS:0;jenkins-hbase4:32803] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 13:13:48,293 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 13:13:48,293 INFO [RS:0;jenkins-hbase4:32803] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 13:13:48,293 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-17 13:13:48,293 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(3305): Received CLOSE for 79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:13:48,294 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(3305): Received CLOSE for 1b89fe16757ad0fa7999b813ad1f00a7 2023-07-17 13:13:48,294 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:48,294 DEBUG [RS:0;jenkins-hbase4:32803] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ff98d89 to 127.0.0.1:62970 2023-07-17 13:13:48,293 DEBUG [Listener at jenkins-hbase4.apache.org/45655] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:48,295 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79c7d7339a0f694eca1cc16099aeb752, disabling compactions & flushes 2023-07-17 13:13:48,295 DEBUG [RS:0;jenkins-hbase4:32803] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:48,293 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 13:13:48,293 INFO [RS:1;jenkins-hbase4:37517] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 13:13:48,296 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-07-17 13:13:48,296 INFO [RS:1;jenkins-hbase4:37517] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 13:13:48,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:13:48,295 INFO [Listener at jenkins-hbase4.apache.org/45655] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-17 13:13:48,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:13:48,296 INFO [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:48,296 INFO [RS:2;jenkins-hbase4:39513] regionserver.HeapMemoryManager(220): Stopping 2023-07-17 13:13:48,296 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1478): Online Regions={79c7d7339a0f694eca1cc16099aeb752=hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752., 1b89fe16757ad0fa7999b813ad1f00a7=hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7.} 2023-07-17 13:13:48,296 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-17 13:13:48,296 INFO [RS:2;jenkins-hbase4:39513] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-17 13:13:48,296 DEBUG [RS:1;jenkins-hbase4:37517] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2411f5c7 to 127.0.0.1:62970 2023-07-17 13:13:48,296 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. after waiting 0 ms 2023-07-17 13:13:48,297 DEBUG [RS:1;jenkins-hbase4:37517] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:48,297 INFO [RS:2;jenkins-hbase4:39513] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-17 13:13:48,297 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:13:48,299 INFO [RS:1;jenkins-hbase4:37517] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 13:13:48,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 79c7d7339a0f694eca1cc16099aeb752 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-17 13:13:48,299 INFO [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:48,299 INFO [RS:1;jenkins-hbase4:37517] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 13:13:48,299 DEBUG [RS:2;jenkins-hbase4:39513] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25af0fff to 127.0.0.1:62970 2023-07-17 13:13:48,300 INFO [RS:1;jenkins-hbase4:37517] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 13:13:48,300 DEBUG [RS:2;jenkins-hbase4:39513] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:48,300 INFO [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39513,1689599458171; all regions closed. 2023-07-17 13:13:48,300 INFO [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-17 13:13:48,300 DEBUG [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1504): Waiting on 1b89fe16757ad0fa7999b813ad1f00a7, 79c7d7339a0f694eca1cc16099aeb752 2023-07-17 13:13:48,301 INFO [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-17 13:13:48,301 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-17 13:13:48,301 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-17 13:13:48,301 DEBUG [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-17 13:13:48,301 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-17 13:13:48,301 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-17 13:13:48,301 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-17 13:13:48,301 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-17 13:13:48,301 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-17 13:13:48,315 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-17 13:13:48,315 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-17 13:13:48,316 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:48,320 DEBUG [RS:2;jenkins-hbase4:39513] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/oldWALs 2023-07-17 13:13:48,320 INFO [RS:2;jenkins-hbase4:39513] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39513%2C1689599458171:(num 1689599460411) 2023-07-17 13:13:48,320 DEBUG [RS:2;jenkins-hbase4:39513] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:48,320 INFO [RS:2;jenkins-hbase4:39513] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:48,322 INFO [RS:2;jenkins-hbase4:39513] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 13:13:48,322 INFO [RS:2;jenkins-hbase4:39513] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 13:13:48,322 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 13:13:48,322 INFO [RS:2;jenkins-hbase4:39513] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 13:13:48,323 INFO [RS:2;jenkins-hbase4:39513] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 13:13:48,324 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:48,339 INFO [RS:2;jenkins-hbase4:39513] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39513 2023-07-17 13:13:48,348 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752/.tmp/info/d5b17694788b46a19208243be806ef86 2023-07-17 13:13:48,353 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/.tmp/info/2fe516694bf24da3bcd126bac59576e2 2023-07-17 13:13:48,356 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:48,362 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2fe516694bf24da3bcd126bac59576e2 2023-07-17 13:13:48,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752/.tmp/info/d5b17694788b46a19208243be806ef86 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752/info/d5b17694788b46a19208243be806ef86 2023-07-17 13:13:48,369 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752/info/d5b17694788b46a19208243be806ef86, entries=2, sequenceid=6, filesize=4.8 K 2023-07-17 13:13:48,370 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 79c7d7339a0f694eca1cc16099aeb752 in 71ms, sequenceid=6, compaction requested=false 2023-07-17 13:13:48,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/namespace/79c7d7339a0f694eca1cc16099aeb752/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-17 13:13:48,389 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:48,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:13:48,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79c7d7339a0f694eca1cc16099aeb752: 2023-07-17 13:13:48,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1689599461020.79c7d7339a0f694eca1cc16099aeb752. 2023-07-17 13:13:48,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1b89fe16757ad0fa7999b813ad1f00a7, disabling compactions & flushes 2023-07-17 13:13:48,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:13:48,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:13:48,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. after waiting 0 ms 2023-07-17 13:13:48,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:13:48,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1b89fe16757ad0fa7999b813ad1f00a7 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-17 13:13:48,392 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/.tmp/rep_barrier/311c379a3269476f9cf3eae872ecdddd 2023-07-17 13:13:48,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 311c379a3269476f9cf3eae872ecdddd 2023-07-17 13:13:48,406 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:48,406 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:48,406 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:48,406 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:48,406 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:48,406 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39513,1689599458171 2023-07-17 13:13:48,407 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:48,411 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7/.tmp/l/d1e222317a6e43dbbda2ed9cdaa36554 2023-07-17 13:13:48,414 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/.tmp/table/f0af339367f7447eb1387ce4f8fa28a6 2023-07-17 13:13:48,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1e222317a6e43dbbda2ed9cdaa36554 2023-07-17 13:13:48,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7/.tmp/l/d1e222317a6e43dbbda2ed9cdaa36554 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7/l/d1e222317a6e43dbbda2ed9cdaa36554 2023-07-17 13:13:48,418 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0af339367f7447eb1387ce4f8fa28a6 2023-07-17 13:13:48,419 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/.tmp/info/2fe516694bf24da3bcd126bac59576e2 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/info/2fe516694bf24da3bcd126bac59576e2 2023-07-17 13:13:48,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1e222317a6e43dbbda2ed9cdaa36554 2023-07-17 13:13:48,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7/l/d1e222317a6e43dbbda2ed9cdaa36554, entries=7, sequenceid=18, filesize=5.2 K 2023-07-17 13:13:48,422 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39513,1689599458171] 2023-07-17 13:13:48,423 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39513,1689599458171; numProcessing=1 2023-07-17 13:13:48,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 1b89fe16757ad0fa7999b813ad1f00a7 in 32ms, sequenceid=18, compaction requested=false 2023-07-17 13:13:48,424 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2fe516694bf24da3bcd126bac59576e2 2023-07-17 13:13:48,425 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/info/2fe516694bf24da3bcd126bac59576e2, entries=48, sequenceid=131, filesize=10.3 K 2023-07-17 13:13:48,425 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/.tmp/rep_barrier/311c379a3269476f9cf3eae872ecdddd as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/rep_barrier/311c379a3269476f9cf3eae872ecdddd 2023-07-17 13:13:48,429 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39513,1689599458171 already deleted, retry=false 2023-07-17 13:13:48,429 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39513,1689599458171 expired; onlineServers=2 2023-07-17 13:13:48,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/acl/1b89fe16757ad0fa7999b813ad1f00a7/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-17 13:13:48,432 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 311c379a3269476f9cf3eae872ecdddd 2023-07-17 13:13:48,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:48,432 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/rep_barrier/311c379a3269476f9cf3eae872ecdddd, entries=13, sequenceid=131, filesize=6.4 K 2023-07-17 13:13:48,433 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:13:48,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1b89fe16757ad0fa7999b813ad1f00a7: 2023-07-17 13:13:48,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1689599461780.1b89fe16757ad0fa7999b813ad1f00a7. 2023-07-17 13:13:48,433 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/.tmp/table/f0af339367f7447eb1387ce4f8fa28a6 as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/table/f0af339367f7447eb1387ce4f8fa28a6 2023-07-17 13:13:48,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0af339367f7447eb1387ce4f8fa28a6 2023-07-17 13:13:48,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/table/f0af339367f7447eb1387ce4f8fa28a6, entries=24, sequenceid=131, filesize=6.9 K 2023-07-17 13:13:48,437 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 136ms, sequenceid=131, compaction requested=false 2023-07-17 13:13:48,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-17 13:13:48,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-17 13:13:48,449 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-17 13:13:48,450 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-17 13:13:48,450 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-17 13:13:48,450 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-17 13:13:48,500 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,32803,1689599458048; all regions closed. 2023-07-17 13:13:48,501 INFO [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,37517,1689599458122; all regions closed. 2023-07-17 13:13:48,508 DEBUG [RS:0;jenkins-hbase4:32803] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/oldWALs 2023-07-17 13:13:48,508 INFO [RS:0;jenkins-hbase4:32803] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C32803%2C1689599458048:(num 1689599460414) 2023-07-17 13:13:48,508 DEBUG [RS:0;jenkins-hbase4:32803] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:48,508 INFO [RS:0;jenkins-hbase4:32803] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:48,509 INFO [RS:0;jenkins-hbase4:32803] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-17 13:13:48,509 DEBUG [RS:1;jenkins-hbase4:37517] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/oldWALs 2023-07-17 13:13:48,509 INFO [RS:0;jenkins-hbase4:32803] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-17 13:13:48,509 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 13:13:48,509 INFO [RS:0;jenkins-hbase4:32803] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-17 13:13:48,509 INFO [RS:0;jenkins-hbase4:32803] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-17 13:13:48,509 INFO [RS:1;jenkins-hbase4:37517] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37517%2C1689599458122.meta:.meta(num 1689599460617) 2023-07-17 13:13:48,510 INFO [RS:0;jenkins-hbase4:32803] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:32803 2023-07-17 13:13:48,512 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:48,512 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:48,512 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,32803,1689599458048 2023-07-17 13:13:48,515 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,32803,1689599458048] 2023-07-17 13:13:48,515 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,32803,1689599458048; numProcessing=2 2023-07-17 13:13:48,516 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,32803,1689599458048 already deleted, retry=false 2023-07-17 13:13:48,516 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,32803,1689599458048 expired; onlineServers=1 2023-07-17 13:13:48,517 DEBUG [RS:1;jenkins-hbase4:37517] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/oldWALs 2023-07-17 13:13:48,518 INFO [RS:1;jenkins-hbase4:37517] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37517%2C1689599458122:(num 1689599460401) 2023-07-17 13:13:48,518 DEBUG [RS:1;jenkins-hbase4:37517] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:48,518 INFO [RS:1;jenkins-hbase4:37517] regionserver.LeaseManager(133): Closed leases 2023-07-17 13:13:48,518 INFO [RS:1;jenkins-hbase4:37517] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-17 13:13:48,518 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 13:13:48,519 INFO [RS:1;jenkins-hbase4:37517] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37517 2023-07-17 13:13:48,520 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37517,1689599458122 2023-07-17 13:13:48,520 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-17 13:13:48,522 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,522 INFO [RS:2;jenkins-hbase4:39513] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39513,1689599458171; zookeeper connection closed. 2023-07-17 13:13:48,522 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:39513-0x101736833f10003, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,522 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@9514d20] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@9514d20 2023-07-17 13:13:48,523 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37517,1689599458122] 2023-07-17 13:13:48,523 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37517,1689599458122; numProcessing=3 2023-07-17 13:13:48,524 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37517,1689599458122 already deleted, retry=false 2023-07-17 13:13:48,524 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,37517,1689599458122 expired; onlineServers=0 2023-07-17 13:13:48,524 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42365,1689599456474' ***** 2023-07-17 13:13:48,524 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-17 13:13:48,524 DEBUG [M:0;jenkins-hbase4:42365] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a46ad90, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-17 13:13:48,524 INFO [M:0;jenkins-hbase4:42365] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42365,1689599456474 2023-07-17 13:13:48,524 INFO [M:0;jenkins-hbase4:42365] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42365,1689599456474; all regions closed. 2023-07-17 13:13:48,524 DEBUG [M:0;jenkins-hbase4:42365] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-17 13:13:48,525 DEBUG [M:0;jenkins-hbase4:42365] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-17 13:13:48,525 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-17 13:13:48,525 DEBUG [M:0;jenkins-hbase4:42365] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-17 13:13:48,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689599459914] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1689599459914,5,FailOnTimeoutGroup] 2023-07-17 13:13:48,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689599459906] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1689599459906,5,FailOnTimeoutGroup] 2023-07-17 13:13:48,525 INFO [M:0;jenkins-hbase4:42365] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-17 13:13:48,525 INFO [M:0;jenkins-hbase4:42365] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-17 13:13:48,525 INFO [M:0;jenkins-hbase4:42365] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-17 13:13:48,525 DEBUG [M:0;jenkins-hbase4:42365] master.HMaster(1512): Stopping service threads 2023-07-17 13:13:48,525 INFO [M:0;jenkins-hbase4:42365] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-17 13:13:48,525 ERROR [M:0;jenkins-hbase4:42365] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-17 13:13:48,526 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-17 13:13:48,526 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-17 13:13:48,526 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-17 13:13:48,526 INFO [M:0;jenkins-hbase4:42365] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-17 13:13:48,526 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-17 13:13:48,526 DEBUG [M:0;jenkins-hbase4:42365] zookeeper.ZKUtil(398): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-17 13:13:48,527 WARN [M:0;jenkins-hbase4:42365] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-17 13:13:48,527 INFO [M:0;jenkins-hbase4:42365] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-17 13:13:48,527 INFO [M:0;jenkins-hbase4:42365] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-17 13:13:48,527 DEBUG [M:0;jenkins-hbase4:42365] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-17 13:13:48,527 INFO [M:0;jenkins-hbase4:42365] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:13:48,527 DEBUG [M:0;jenkins-hbase4:42365] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:13:48,527 DEBUG [M:0;jenkins-hbase4:42365] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-17 13:13:48,527 DEBUG [M:0;jenkins-hbase4:42365] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:13:48,527 INFO [M:0;jenkins-hbase4:42365] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.64 KB heapSize=451.91 KB 2023-07-17 13:13:48,552 INFO [M:0;jenkins-hbase4:42365] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.64 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9445c00bca9e44adb2996d1ceb3f2bbf 2023-07-17 13:13:48,557 INFO [M:0;jenkins-hbase4:42365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9445c00bca9e44adb2996d1ceb3f2bbf 2023-07-17 13:13:48,558 DEBUG [M:0;jenkins-hbase4:42365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/9445c00bca9e44adb2996d1ceb3f2bbf as hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9445c00bca9e44adb2996d1ceb3f2bbf 2023-07-17 13:13:48,567 INFO [M:0;jenkins-hbase4:42365] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9445c00bca9e44adb2996d1ceb3f2bbf 2023-07-17 13:13:48,567 INFO [M:0;jenkins-hbase4:42365] regionserver.HStore(1080): Added hdfs://localhost:42441/user/jenkins/test-data/f62fc288-66d0-277a-705e-8d08fb74f295/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/9445c00bca9e44adb2996d1ceb3f2bbf, entries=119, sequenceid=899, filesize=28.6 K 2023-07-17 13:13:48,570 INFO [M:0;jenkins-hbase4:42365] regionserver.HRegion(2948): Finished flush of dataSize ~375.64 KB/384658, heapSize ~451.89 KB/462736, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 43ms, sequenceid=899, compaction requested=false 2023-07-17 13:13:48,572 INFO [M:0;jenkins-hbase4:42365] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-17 13:13:48,572 DEBUG [M:0;jenkins-hbase4:42365] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-17 13:13:48,579 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-17 13:13:48,579 INFO [M:0;jenkins-hbase4:42365] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-17 13:13:48,580 INFO [M:0;jenkins-hbase4:42365] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42365 2023-07-17 13:13:48,582 DEBUG [M:0;jenkins-hbase4:42365] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42365,1689599456474 already deleted, retry=false 2023-07-17 13:13:48,622 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,622 INFO [RS:0;jenkins-hbase4:32803] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,32803,1689599458048; zookeeper connection closed. 2023-07-17 13:13:48,622 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:32803-0x101736833f10001, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,623 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@626fa4dd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@626fa4dd 2023-07-17 13:13:48,722 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,722 INFO [M:0;jenkins-hbase4:42365] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42365,1689599456474; zookeeper connection closed. 2023-07-17 13:13:48,722 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): master:42365-0x101736833f10000, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,822 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,822 INFO [RS:1;jenkins-hbase4:37517] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,37517,1689599458122; zookeeper connection closed. 2023-07-17 13:13:48,823 DEBUG [Listener at localhost/37125-EventThread] zookeeper.ZKWatcher(600): regionserver:37517-0x101736833f10002, quorum=127.0.0.1:62970, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-17 13:13:48,823 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@38da1004] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@38da1004 2023-07-17 13:13:48,823 INFO [Listener at jenkins-hbase4.apache.org/45655] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-17 13:13:48,823 WARN [Listener at jenkins-hbase4.apache.org/45655] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 13:13:48,828 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 13:13:48,933 WARN [BP-473373068-172.31.14.131-1689599452137 heartbeating to localhost/127.0.0.1:42441] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 13:13:48,933 WARN [BP-473373068-172.31.14.131-1689599452137 heartbeating to localhost/127.0.0.1:42441] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-473373068-172.31.14.131-1689599452137 (Datanode Uuid eac0df03-528f-4964-ace4-2670b845cc12) service to localhost/127.0.0.1:42441 2023-07-17 13:13:48,936 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data6/current/BP-473373068-172.31.14.131-1689599452137] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:48,937 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data5/current/BP-473373068-172.31.14.131-1689599452137] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:48,938 WARN [Listener at jenkins-hbase4.apache.org/45655] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 13:13:48,942 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 13:13:48,945 WARN [BP-473373068-172.31.14.131-1689599452137 heartbeating to localhost/127.0.0.1:42441] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 13:13:48,945 WARN [BP-473373068-172.31.14.131-1689599452137 heartbeating to localhost/127.0.0.1:42441] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-473373068-172.31.14.131-1689599452137 (Datanode Uuid abdcd795-709d-4f6e-a096-f1fdb02d44e6) service to localhost/127.0.0.1:42441 2023-07-17 13:13:48,946 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data3/current/BP-473373068-172.31.14.131-1689599452137] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:48,947 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data4/current/BP-473373068-172.31.14.131-1689599452137] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:48,948 WARN [Listener at jenkins-hbase4.apache.org/45655] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-17 13:13:48,951 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 13:13:49,055 WARN [BP-473373068-172.31.14.131-1689599452137 heartbeating to localhost/127.0.0.1:42441] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-17 13:13:49,055 WARN [BP-473373068-172.31.14.131-1689599452137 heartbeating to localhost/127.0.0.1:42441] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-473373068-172.31.14.131-1689599452137 (Datanode Uuid b7a0307b-1e64-4b68-bd96-9d64ea240dee) service to localhost/127.0.0.1:42441 2023-07-17 13:13:49,056 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data1/current/BP-473373068-172.31.14.131-1689599452137] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:49,056 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/5182ebc5-73c9-9191-c6d9-41c264a30b40/cluster_18865da0-41bb-7402-b9f4-a559402517ec/dfs/data/data2/current/BP-473373068-172.31.14.131-1689599452137] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-17 13:13:49,077 INFO [Listener at jenkins-hbase4.apache.org/45655] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-17 13:13:49,207 INFO [Listener at jenkins-hbase4.apache.org/45655] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-17 13:13:49,343 INFO [Listener at jenkins-hbase4.apache.org/45655] hbase.HBaseTestingUtility(1293): Minicluster is down