2023-09-12 19:00:02,540 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-12 19:00:02,740 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377 2023-09-12 19:00:02,740 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-12 19:00:02,741 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-12 19:00:02,780 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-12 19:00:02,975 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-12 19:00:02,976 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614, deleteOnExit=true 2023-09-12 19:00:02,976 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-12 19:00:02,977 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/test.cache.data in system properties and HBase conf 2023-09-12 19:00:02,977 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop.tmp.dir in system properties and HBase conf 2023-09-12 19:00:02,977 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop.log.dir in system properties and HBase conf 2023-09-12 19:00:02,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-12 19:00:02,978 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-12 19:00:02,978 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-12 19:00:03,257 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-12 19:00:03,262 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-12 19:00:03,262 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-12 19:00:03,262 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-12 19:00:03,263 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-12 19:00:03,263 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-12 19:00:03,263 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-12 19:00:03,264 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-12 19:00:03,264 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-12 19:00:03,265 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-12 19:00:03,265 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/nfs.dump.dir in system properties and HBase conf 2023-09-12 19:00:03,266 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/java.io.tmpdir in system properties and HBase conf 2023-09-12 19:00:03,266 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-12 19:00:03,266 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-12 19:00:03,267 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-12 19:00:03,799 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-12 19:00:03,805 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-12 19:00:04,078 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-12 19:00:04,279 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-12 19:00:04,294 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 19:00:04,333 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 19:00:04,370 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/java.io.tmpdir/Jetty_localhost_39595_hdfs____pfx6z9/webapp 2023-09-12 19:00:04,532 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39595 2023-09-12 19:00:04,593 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-12 19:00:04,593 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-12 19:00:05,036 WARN [Listener at localhost/36845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-12 19:00:05,125 WARN [Listener at localhost/36845] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-12 19:00:05,143 WARN [Listener at localhost/36845] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 19:00:05,151 INFO [Listener at localhost/36845] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 19:00:05,156 INFO [Listener at localhost/36845] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/java.io.tmpdir/Jetty_localhost_41673_datanode____a69pwc/webapp 2023-09-12 19:00:05,238 INFO [Listener at localhost/36845] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41673 2023-09-12 19:00:05,689 WARN [Listener at localhost/37081] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-12 19:00:05,711 WARN [Listener at localhost/37081] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-12 19:00:05,718 WARN [Listener at localhost/37081] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 19:00:05,720 INFO [Listener at localhost/37081] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 19:00:05,727 INFO [Listener at localhost/37081] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/java.io.tmpdir/Jetty_localhost_38365_datanode____.5dzjl8/webapp 2023-09-12 19:00:05,805 INFO [Listener at localhost/37081] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38365 2023-09-12 19:00:05,815 WARN [Listener at localhost/36443] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-12 19:00:05,828 WARN [Listener at localhost/36443] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-12 19:00:05,830 WARN [Listener at localhost/36443] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 19:00:05,832 INFO [Listener at localhost/36443] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 19:00:05,840 INFO [Listener at localhost/36443] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/java.io.tmpdir/Jetty_localhost_37871_datanode____.3aq3fv/webapp 2023-09-12 19:00:05,996 INFO [Listener at localhost/36443] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37871 2023-09-12 19:00:06,018 WARN [Listener at localhost/33845] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-12 19:00:06,182 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x89d762a395d66096: Processing first storage report for DS-6b87871f-3e57-4728-83ab-380102c98b59 from datanode 5095356f-844e-4776-ab5d-9beef59fc9b8 2023-09-12 19:00:06,183 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x89d762a395d66096: from storage DS-6b87871f-3e57-4728-83ab-380102c98b59 node DatanodeRegistration(127.0.0.1:33023, datanodeUuid=5095356f-844e-4776-ab5d-9beef59fc9b8, infoPort=37467, infoSecurePort=0, ipcPort=33845, storageInfo=lv=-57;cid=testClusterID;nsid=854921184;c=1694545203900), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-09-12 19:00:06,183 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17b175f17e917b58: Processing first storage report for DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39 from datanode cfe64026-3f68-4c30-8451-8f26c1ff6228 2023-09-12 19:00:06,184 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17b175f17e917b58: from storage DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39 node DatanodeRegistration(127.0.0.1:45005, datanodeUuid=cfe64026-3f68-4c30-8451-8f26c1ff6228, infoPort=36559, infoSecurePort=0, ipcPort=36443, storageInfo=lv=-57;cid=testClusterID;nsid=854921184;c=1694545203900), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-12 19:00:06,184 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x19bcaad195f34d5e: Processing first storage report for DS-5b260b88-3cc6-4064-ab52-ec20e8711784 from datanode 676c22c9-cf3c-460a-b74a-ff719c721a87 2023-09-12 19:00:06,184 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x19bcaad195f34d5e: from storage DS-5b260b88-3cc6-4064-ab52-ec20e8711784 node DatanodeRegistration(127.0.0.1:40247, datanodeUuid=676c22c9-cf3c-460a-b74a-ff719c721a87, infoPort=36415, infoSecurePort=0, ipcPort=37081, storageInfo=lv=-57;cid=testClusterID;nsid=854921184;c=1694545203900), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-12 19:00:06,184 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x89d762a395d66096: Processing first storage report for DS-534ff650-d5b2-485c-af4b-532a4ef60a3f from datanode 5095356f-844e-4776-ab5d-9beef59fc9b8 2023-09-12 19:00:06,184 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x89d762a395d66096: from storage DS-534ff650-d5b2-485c-af4b-532a4ef60a3f node DatanodeRegistration(127.0.0.1:33023, datanodeUuid=5095356f-844e-4776-ab5d-9beef59fc9b8, infoPort=37467, infoSecurePort=0, ipcPort=33845, storageInfo=lv=-57;cid=testClusterID;nsid=854921184;c=1694545203900), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-12 19:00:06,184 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x17b175f17e917b58: Processing first storage report for DS-c518dca3-9fa5-40c6-b77a-2f929999da02 from datanode cfe64026-3f68-4c30-8451-8f26c1ff6228 2023-09-12 19:00:06,184 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x17b175f17e917b58: from storage DS-c518dca3-9fa5-40c6-b77a-2f929999da02 node DatanodeRegistration(127.0.0.1:45005, datanodeUuid=cfe64026-3f68-4c30-8451-8f26c1ff6228, infoPort=36559, infoSecurePort=0, ipcPort=36443, storageInfo=lv=-57;cid=testClusterID;nsid=854921184;c=1694545203900), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-12 19:00:06,184 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x19bcaad195f34d5e: Processing first storage report for DS-8452c6f2-ff94-48ce-91d7-61e1b0cf28dd from datanode 676c22c9-cf3c-460a-b74a-ff719c721a87 2023-09-12 19:00:06,185 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x19bcaad195f34d5e: from storage DS-8452c6f2-ff94-48ce-91d7-61e1b0cf28dd node DatanodeRegistration(127.0.0.1:40247, datanodeUuid=676c22c9-cf3c-460a-b74a-ff719c721a87, infoPort=36415, infoSecurePort=0, ipcPort=37081, storageInfo=lv=-57;cid=testClusterID;nsid=854921184;c=1694545203900), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-12 19:00:06,482 DEBUG [Listener at localhost/33845] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377 2023-09-12 19:00:06,566 INFO [Listener at localhost/33845] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/zookeeper_0, clientPort=53172, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-12 19:00:06,585 INFO [Listener at localhost/33845] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53172 2023-09-12 19:00:06,592 INFO [Listener at localhost/33845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:06,593 INFO [Listener at localhost/33845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:07,250 INFO [Listener at localhost/33845] util.FSUtils(471): Created version file at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 with version=8 2023-09-12 19:00:07,251 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/hbase-staging 2023-09-12 19:00:07,621 INFO [Listener at localhost/33845] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-12 19:00:08,026 INFO [Listener at localhost/33845] client.ConnectionUtils(127): master/jenkins-hbase20:0 server-side Connection retries=45 2023-09-12 19:00:08,054 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,055 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,055 INFO [Listener at localhost/33845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-12 19:00:08,055 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,055 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-12 19:00:08,181 INFO [Listener at localhost/33845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-12 19:00:08,241 DEBUG [Listener at localhost/33845] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-12 19:00:08,323 INFO [Listener at localhost/33845] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38069 2023-09-12 19:00:08,334 INFO [Listener at localhost/33845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:08,336 INFO [Listener at localhost/33845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:08,357 INFO [Listener at localhost/33845] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38069 connecting to ZooKeeper ensemble=127.0.0.1:53172 2023-09-12 19:00:08,407 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:380690x0, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-12 19:00:08,410 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38069-0x1008d06ae340000 connected 2023-09-12 19:00:08,435 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-12 19:00:08,436 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 19:00:08,447 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-12 19:00:08,454 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38069 2023-09-12 19:00:08,455 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38069 2023-09-12 19:00:08,456 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38069 2023-09-12 19:00:08,457 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38069 2023-09-12 19:00:08,457 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38069 2023-09-12 19:00:08,462 INFO [Listener at localhost/33845] master.HMaster(444): hbase.rootdir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0, hbase.cluster.distributed=false 2023-09-12 19:00:08,518 INFO [Listener at localhost/33845] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-12 19:00:08,518 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,518 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,518 INFO [Listener at localhost/33845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-12 19:00:08,518 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,519 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-12 19:00:08,523 INFO [Listener at localhost/33845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-12 19:00:08,526 INFO [Listener at localhost/33845] ipc.NettyRpcServer(120): Bind to /148.251.75.209:42275 2023-09-12 19:00:08,528 INFO [Listener at localhost/33845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-12 19:00:08,534 INFO [Listener at localhost/33845] mob.MobFileCache(124): MobFileCache disabled 2023-09-12 19:00:08,535 INFO [Listener at localhost/33845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:08,538 INFO [Listener at localhost/33845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:08,542 INFO [Listener at localhost/33845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42275 connecting to ZooKeeper ensemble=127.0.0.1:53172 2023-09-12 19:00:08,545 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:422750x0, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-12 19:00:08,546 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42275-0x1008d06ae340001 connected 2023-09-12 19:00:08,546 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-12 19:00:08,548 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 19:00:08,549 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-12 19:00:08,550 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42275 2023-09-12 19:00:08,550 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42275 2023-09-12 19:00:08,554 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42275 2023-09-12 19:00:08,555 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42275 2023-09-12 19:00:08,555 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42275 2023-09-12 19:00:08,565 INFO [Listener at localhost/33845] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-12 19:00:08,565 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,566 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,566 INFO [Listener at localhost/33845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-12 19:00:08,566 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,566 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-12 19:00:08,566 INFO [Listener at localhost/33845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-12 19:00:08,570 INFO [Listener at localhost/33845] ipc.NettyRpcServer(120): Bind to /148.251.75.209:38579 2023-09-12 19:00:08,571 INFO [Listener at localhost/33845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-12 19:00:08,572 INFO [Listener at localhost/33845] mob.MobFileCache(124): MobFileCache disabled 2023-09-12 19:00:08,573 INFO [Listener at localhost/33845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:08,575 INFO [Listener at localhost/33845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:08,579 INFO [Listener at localhost/33845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38579 connecting to ZooKeeper ensemble=127.0.0.1:53172 2023-09-12 19:00:08,585 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:385790x0, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-12 19:00:08,586 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): regionserver:385790x0, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-12 19:00:08,586 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38579-0x1008d06ae340002 connected 2023-09-12 19:00:08,587 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 19:00:08,588 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-12 19:00:08,590 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38579 2023-09-12 19:00:08,591 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38579 2023-09-12 19:00:08,591 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38579 2023-09-12 19:00:08,592 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38579 2023-09-12 19:00:08,592 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38579 2023-09-12 19:00:08,603 INFO [Listener at localhost/33845] client.ConnectionUtils(127): regionserver/jenkins-hbase20:0 server-side Connection retries=45 2023-09-12 19:00:08,603 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,603 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,603 INFO [Listener at localhost/33845] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-12 19:00:08,603 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-12 19:00:08,604 INFO [Listener at localhost/33845] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-12 19:00:08,604 INFO [Listener at localhost/33845] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-12 19:00:08,605 INFO [Listener at localhost/33845] ipc.NettyRpcServer(120): Bind to /148.251.75.209:36759 2023-09-12 19:00:08,605 INFO [Listener at localhost/33845] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-12 19:00:08,607 INFO [Listener at localhost/33845] mob.MobFileCache(124): MobFileCache disabled 2023-09-12 19:00:08,608 INFO [Listener at localhost/33845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:08,609 INFO [Listener at localhost/33845] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:08,611 INFO [Listener at localhost/33845] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36759 connecting to ZooKeeper ensemble=127.0.0.1:53172 2023-09-12 19:00:08,614 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:367590x0, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-12 19:00:08,615 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): regionserver:367590x0, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-12 19:00:08,615 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36759-0x1008d06ae340003 connected 2023-09-12 19:00:08,616 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 19:00:08,616 DEBUG [Listener at localhost/33845] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-12 19:00:08,622 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36759 2023-09-12 19:00:08,623 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36759 2023-09-12 19:00:08,623 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36759 2023-09-12 19:00:08,626 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36759 2023-09-12 19:00:08,627 DEBUG [Listener at localhost/33845] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36759 2023-09-12 19:00:08,630 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase20.apache.org,38069,1694545207479 2023-09-12 19:00:08,637 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-12 19:00:08,639 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase20.apache.org,38069,1694545207479 2023-09-12 19:00:08,655 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-12 19:00:08,655 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-12 19:00:08,655 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-12 19:00:08,655 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-12 19:00:08,655 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:00:08,656 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-12 19:00:08,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-12 19:00:08,658 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase20.apache.org,38069,1694545207479 from backup master directory 2023-09-12 19:00:08,661 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase20.apache.org,38069,1694545207479 2023-09-12 19:00:08,662 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-12 19:00:08,662 WARN [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-12 19:00:08,662 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase20.apache.org,38069,1694545207479 2023-09-12 19:00:08,665 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-12 19:00:08,667 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-12 19:00:08,755 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/hbase.id with ID: 037c898d-6224-49b0-90d2-ea98b3c19b9c 2023-09-12 19:00:08,802 INFO [master/jenkins-hbase20:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-12 19:00:08,818 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:00:08,868 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6c39a083 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:08,899 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73d8e1a3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:08,924 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-12 19:00:08,926 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-12 19:00:08,943 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-12 19:00:08,943 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-12 19:00:08,946 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-12 19:00:08,950 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-12 19:00:08,952 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-12 19:00:08,983 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/data/master/store-tmp 2023-09-12 19:00:09,018 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:09,019 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-12 19:00:09,019 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 19:00:09,019 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 19:00:09,019 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-12 19:00:09,019 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 19:00:09,019 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 19:00:09,019 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-12 19:00:09,021 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/WALs/jenkins-hbase20.apache.org,38069,1694545207479 2023-09-12 19:00:09,042 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38069%2C1694545207479, suffix=, logDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/WALs/jenkins-hbase20.apache.org,38069,1694545207479, archiveDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/oldWALs, maxLogs=10 2023-09-12 19:00:09,103 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40247,DS-5b260b88-3cc6-4064-ab52-ec20e8711784,DISK] 2023-09-12 19:00:09,103 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33023,DS-6b87871f-3e57-4728-83ab-380102c98b59,DISK] 2023-09-12 19:00:09,103 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45005,DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39,DISK] 2023-09-12 19:00:09,114 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-12 19:00:09,185 INFO [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/WALs/jenkins-hbase20.apache.org,38069,1694545207479/jenkins-hbase20.apache.org%2C38069%2C1694545207479.1694545209052 2023-09-12 19:00:09,186 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45005,DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39,DISK], DatanodeInfoWithStorage[127.0.0.1:33023,DS-6b87871f-3e57-4728-83ab-380102c98b59,DISK], DatanodeInfoWithStorage[127.0.0.1:40247,DS-5b260b88-3cc6-4064-ab52-ec20e8711784,DISK]] 2023-09-12 19:00:09,186 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-12 19:00:09,187 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:09,190 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-12 19:00:09,191 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-12 19:00:09,258 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-12 19:00:09,266 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-12 19:00:09,296 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-12 19:00:09,310 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:09,316 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-12 19:00:09,319 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-12 19:00:09,337 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-12 19:00:09,342 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:00:09,343 INFO [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71312140, jitterRate=0.0626336932182312}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:00:09,343 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-12 19:00:09,345 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-12 19:00:09,374 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-12 19:00:09,374 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-12 19:00:09,377 INFO [master/jenkins-hbase20:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-12 19:00:09,379 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-12 19:00:09,411 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 31 msec 2023-09-12 19:00:09,411 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-12 19:00:09,436 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-12 19:00:09,441 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-12 19:00:09,467 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-12 19:00:09,473 INFO [master/jenkins-hbase20:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-12 19:00:09,475 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-12 19:00:09,480 INFO [master/jenkins-hbase20:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-12 19:00:09,484 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-12 19:00:09,486 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:00:09,488 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-12 19:00:09,489 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-12 19:00:09,503 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-12 19:00:09,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-12 19:00:09,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-12 19:00:09,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-12 19:00:09,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-12 19:00:09,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:00:09,509 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase20.apache.org,38069,1694545207479, sessionid=0x1008d06ae340000, setting cluster-up flag (Was=false) 2023-09-12 19:00:09,526 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:00:09,530 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-12 19:00:09,532 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,38069,1694545207479 2023-09-12 19:00:09,536 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:00:09,540 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-12 19:00:09,541 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase20.apache.org,38069,1694545207479 2023-09-12 19:00:09,544 WARN [master/jenkins-hbase20:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp 2023-09-12 19:00:09,625 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-12 19:00:09,629 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:09,629 INFO [master/jenkins-hbase20:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-12 19:00:09,632 INFO [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(951): ClusterId : 037c898d-6224-49b0-90d2-ea98b3c19b9c 2023-09-12 19:00:09,632 INFO [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(951): ClusterId : 037c898d-6224-49b0-90d2-ea98b3c19b9c 2023-09-12 19:00:09,632 INFO [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(951): ClusterId : 037c898d-6224-49b0-90d2-ea98b3c19b9c 2023-09-12 19:00:09,637 DEBUG [RS:1;jenkins-hbase20:38579] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-12 19:00:09,637 DEBUG [RS:2;jenkins-hbase20:36759] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-12 19:00:09,637 DEBUG [RS:0;jenkins-hbase20:42275] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-12 19:00:09,643 DEBUG [RS:1;jenkins-hbase20:38579] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-12 19:00:09,643 DEBUG [RS:0;jenkins-hbase20:42275] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-12 19:00:09,643 DEBUG [RS:2;jenkins-hbase20:36759] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-12 19:00:09,643 DEBUG [RS:0;jenkins-hbase20:42275] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-12 19:00:09,643 DEBUG [RS:1;jenkins-hbase20:38579] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-12 19:00:09,643 DEBUG [RS:2;jenkins-hbase20:36759] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-12 19:00:09,647 DEBUG [RS:0;jenkins-hbase20:42275] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-12 19:00:09,647 DEBUG [RS:2;jenkins-hbase20:36759] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-12 19:00:09,647 DEBUG [RS:1;jenkins-hbase20:38579] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-12 19:00:09,650 DEBUG [RS:0;jenkins-hbase20:42275] zookeeper.ReadOnlyZKClient(139): Connect 0x3b71ae1a to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:09,651 DEBUG [RS:1;jenkins-hbase20:38579] zookeeper.ReadOnlyZKClient(139): Connect 0x7906552c to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:09,651 DEBUG [RS:2;jenkins-hbase20:36759] zookeeper.ReadOnlyZKClient(139): Connect 0x67b9810f to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:09,662 DEBUG [RS:0;jenkins-hbase20:42275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35b64704, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:09,662 DEBUG [RS:1;jenkins-hbase20:38579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77c1b47c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:09,663 DEBUG [RS:0;jenkins-hbase20:42275] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3189c56a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-12 19:00:09,663 DEBUG [RS:1;jenkins-hbase20:38579] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73fe3e5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-12 19:00:09,691 DEBUG [RS:2;jenkins-hbase20:36759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@697e6388, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:09,691 DEBUG [RS:2;jenkins-hbase20:36759] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@284369b3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-12 19:00:09,713 DEBUG [RS:1;jenkins-hbase20:38579] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase20:38579 2023-09-12 19:00:09,713 DEBUG [RS:2;jenkins-hbase20:36759] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase20:36759 2023-09-12 19:00:09,713 DEBUG [RS:0;jenkins-hbase20:42275] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase20:42275 2023-09-12 19:00:09,720 INFO [RS:1;jenkins-hbase20:38579] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-12 19:00:09,720 INFO [RS:2;jenkins-hbase20:36759] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-12 19:00:09,720 INFO [RS:0;jenkins-hbase20:42275] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-12 19:00:09,721 INFO [RS:0;jenkins-hbase20:42275] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-12 19:00:09,721 INFO [RS:2;jenkins-hbase20:36759] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-12 19:00:09,721 INFO [RS:1;jenkins-hbase20:38579] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-12 19:00:09,721 DEBUG [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-12 19:00:09,721 DEBUG [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-12 19:00:09,721 DEBUG [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-12 19:00:09,722 INFO [RS:2;jenkins-hbase20:36759] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:09,722 INFO [RS:0;jenkins-hbase20:42275] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:09,722 DEBUG [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(1022): About to register with Master. 2023-09-12 19:00:09,722 INFO [RS:1;jenkins-hbase20:38579] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:09,722 DEBUG [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1022): About to register with Master. 2023-09-12 19:00:09,722 DEBUG [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1022): About to register with Master. 2023-09-12 19:00:09,725 INFO [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38069,1694545207479 with isa=jenkins-hbase20.apache.org/148.251.75.209:36759, startcode=1694545208602 2023-09-12 19:00:09,725 INFO [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38069,1694545207479 with isa=jenkins-hbase20.apache.org/148.251.75.209:38579, startcode=1694545208565 2023-09-12 19:00:09,725 INFO [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase20.apache.org,38069,1694545207479 with isa=jenkins-hbase20.apache.org/148.251.75.209:42275, startcode=1694545208517 2023-09-12 19:00:09,729 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-12 19:00:09,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-12 19:00:09,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-12 19:00:09,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-12 19:00:09,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=5, maxPoolSize=5 2023-09-12 19:00:09,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase20:0, corePoolSize=10, maxPoolSize=10 2023-09-12 19:00:09,741 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,742 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-12 19:00:09,742 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,742 DEBUG [RS:0;jenkins-hbase20:42275] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-12 19:00:09,742 DEBUG [RS:1;jenkins-hbase20:38579] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-12 19:00:09,742 DEBUG [RS:2;jenkins-hbase20:36759] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-12 19:00:09,746 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1694545239745 2023-09-12 19:00:09,749 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-12 19:00:09,752 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-12 19:00:09,752 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-12 19:00:09,758 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-12 19:00:09,760 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-12 19:00:09,769 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-12 19:00:09,769 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-12 19:00:09,770 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-12 19:00:09,770 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-12 19:00:09,778 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,780 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-12 19:00:09,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-12 19:00:09,783 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-12 19:00:09,788 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-12 19:00:09,789 INFO [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-12 19:00:09,791 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1694545209790,5,FailOnTimeoutGroup] 2023-09-12 19:00:09,793 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1694545209791,5,FailOnTimeoutGroup] 2023-09-12 19:00:09,793 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,794 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-12 19:00:09,799 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,800 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,816 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-12 19:00:09,818 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-12 19:00:09,818 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:00:09,820 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:50615, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-12 19:00:09,820 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:53627, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-12 19:00:09,820 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:43575, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-12 19:00:09,838 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38069] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:09,854 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:09,855 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38069] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:09,856 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38069] master.ServerManager(394): Registering regionserver=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:09,860 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-12 19:00:09,862 DEBUG [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:00:09,862 DEBUG [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:00:09,862 DEBUG [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:00:09,862 DEBUG [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36845 2023-09-12 19:00:09,862 DEBUG [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36845 2023-09-12 19:00:09,863 DEBUG [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-12 19:00:09,862 DEBUG [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:36845 2023-09-12 19:00:09,863 DEBUG [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-12 19:00:09,863 DEBUG [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-12 19:00:09,863 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/info 2023-09-12 19:00:09,864 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-12 19:00:09,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:09,865 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-12 19:00:09,867 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 19:00:09,870 DEBUG [RS:0;jenkins-hbase20:42275] zookeeper.ZKUtil(162): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:09,870 WARN [RS:0;jenkins-hbase20:42275] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-12 19:00:09,870 INFO [RS:0;jenkins-hbase20:42275] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-12 19:00:09,870 DEBUG [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:09,870 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,42275,1694545208517] 2023-09-12 19:00:09,870 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,36759,1694545208602] 2023-09-12 19:00:09,870 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase20.apache.org,38579,1694545208565] 2023-09-12 19:00:09,870 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/rep_barrier 2023-09-12 19:00:09,871 DEBUG [RS:1;jenkins-hbase20:38579] zookeeper.ZKUtil(162): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:09,871 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-12 19:00:09,871 WARN [RS:1;jenkins-hbase20:38579] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-12 19:00:09,871 DEBUG [RS:2;jenkins-hbase20:36759] zookeeper.ZKUtil(162): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:09,873 INFO [RS:1;jenkins-hbase20:38579] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-12 19:00:09,873 WARN [RS:2;jenkins-hbase20:36759] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-12 19:00:09,873 DEBUG [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:09,873 INFO [RS:2;jenkins-hbase20:36759] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-12 19:00:09,874 DEBUG [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1948): logDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:09,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:09,874 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-12 19:00:09,876 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/table 2023-09-12 19:00:09,877 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-12 19:00:09,880 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:09,883 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740 2023-09-12 19:00:09,884 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740 2023-09-12 19:00:09,888 DEBUG [RS:0;jenkins-hbase20:42275] zookeeper.ZKUtil(162): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:09,888 DEBUG [RS:2;jenkins-hbase20:36759] zookeeper.ZKUtil(162): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:09,888 DEBUG [RS:1;jenkins-hbase20:38579] zookeeper.ZKUtil(162): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:09,888 DEBUG [RS:0;jenkins-hbase20:42275] zookeeper.ZKUtil(162): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:09,888 DEBUG [RS:2;jenkins-hbase20:36759] zookeeper.ZKUtil(162): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:09,889 DEBUG [RS:1;jenkins-hbase20:38579] zookeeper.ZKUtil(162): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:09,889 DEBUG [RS:0;jenkins-hbase20:42275] zookeeper.ZKUtil(162): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:09,889 DEBUG [RS:1;jenkins-hbase20:38579] zookeeper.ZKUtil(162): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:09,890 DEBUG [RS:2;jenkins-hbase20:36759] zookeeper.ZKUtil(162): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:09,890 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-12 19:00:09,893 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-12 19:00:09,898 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:00:09,899 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61114537, jitterRate=-0.08932243287563324}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-12 19:00:09,900 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-12 19:00:09,900 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-12 19:00:09,900 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-12 19:00:09,900 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-12 19:00:09,900 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-12 19:00:09,900 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-12 19:00:09,902 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-12 19:00:09,902 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-12 19:00:09,903 DEBUG [RS:2;jenkins-hbase20:36759] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-12 19:00:09,903 DEBUG [RS:1;jenkins-hbase20:38579] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-12 19:00:09,903 DEBUG [RS:0;jenkins-hbase20:42275] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-12 19:00:09,911 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-12 19:00:09,911 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-12 19:00:09,916 INFO [RS:2;jenkins-hbase20:36759] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-12 19:00:09,916 INFO [RS:0;jenkins-hbase20:42275] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-12 19:00:09,916 INFO [RS:1;jenkins-hbase20:38579] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-12 19:00:09,923 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-12 19:00:09,940 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-12 19:00:09,943 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-12 19:00:09,944 INFO [RS:1;jenkins-hbase20:38579] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-12 19:00:09,944 INFO [RS:2;jenkins-hbase20:36759] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-12 19:00:09,945 INFO [RS:0;jenkins-hbase20:42275] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-12 19:00:09,949 INFO [RS:2;jenkins-hbase20:36759] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-12 19:00:09,949 INFO [RS:1;jenkins-hbase20:38579] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-12 19:00:09,949 INFO [RS:0;jenkins-hbase20:42275] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-12 19:00:09,950 INFO [RS:1;jenkins-hbase20:38579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,949 INFO [RS:2;jenkins-hbase20:36759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,950 INFO [RS:0;jenkins-hbase20:42275] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,950 INFO [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-12 19:00:09,950 INFO [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-12 19:00:09,950 INFO [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-12 19:00:09,959 INFO [RS:0;jenkins-hbase20:42275] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,959 INFO [RS:2;jenkins-hbase20:36759] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,959 INFO [RS:1;jenkins-hbase20:38579] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,959 DEBUG [RS:0;jenkins-hbase20:42275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,959 DEBUG [RS:2;jenkins-hbase20:36759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,960 DEBUG [RS:0;jenkins-hbase20:42275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,960 DEBUG [RS:1;jenkins-hbase20:38579] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,960 DEBUG [RS:2;jenkins-hbase20:36759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,960 DEBUG [RS:1;jenkins-hbase20:38579] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,960 DEBUG [RS:0;jenkins-hbase20:42275] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,960 DEBUG [RS:1;jenkins-hbase20:38579] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,960 DEBUG [RS:2;jenkins-hbase20:36759] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,960 DEBUG [RS:1;jenkins-hbase20:38579] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,960 DEBUG [RS:0;jenkins-hbase20:42275] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,961 DEBUG [RS:1;jenkins-hbase20:38579] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,961 DEBUG [RS:2;jenkins-hbase20:36759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,961 DEBUG [RS:1;jenkins-hbase20:38579] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-12 19:00:09,961 DEBUG [RS:0;jenkins-hbase20:42275] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,961 DEBUG [RS:1;jenkins-hbase20:38579] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,961 DEBUG [RS:2;jenkins-hbase20:36759] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,961 DEBUG [RS:1;jenkins-hbase20:38579] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,961 DEBUG [RS:0;jenkins-hbase20:42275] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-12 19:00:09,961 DEBUG [RS:2;jenkins-hbase20:36759] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase20:0, corePoolSize=2, maxPoolSize=2 2023-09-12 19:00:09,961 DEBUG [RS:0;jenkins-hbase20:42275] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,961 DEBUG [RS:2;jenkins-hbase20:36759] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,962 DEBUG [RS:0;jenkins-hbase20:42275] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,962 DEBUG [RS:2;jenkins-hbase20:36759] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,962 DEBUG [RS:0;jenkins-hbase20:42275] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,962 DEBUG [RS:2;jenkins-hbase20:36759] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,962 DEBUG [RS:0;jenkins-hbase20:42275] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,961 DEBUG [RS:1;jenkins-hbase20:38579] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,962 DEBUG [RS:2;jenkins-hbase20:36759] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,962 DEBUG [RS:1;jenkins-hbase20:38579] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase20:0, corePoolSize=1, maxPoolSize=1 2023-09-12 19:00:09,970 INFO [RS:2;jenkins-hbase20:36759] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,970 INFO [RS:0;jenkins-hbase20:42275] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,971 INFO [RS:2;jenkins-hbase20:36759] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,971 INFO [RS:0;jenkins-hbase20:42275] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,970 INFO [RS:1;jenkins-hbase20:38579] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,971 INFO [RS:0;jenkins-hbase20:42275] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,971 INFO [RS:2;jenkins-hbase20:36759] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,971 INFO [RS:1;jenkins-hbase20:38579] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,971 INFO [RS:1;jenkins-hbase20:38579] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,984 INFO [RS:2;jenkins-hbase20:36759] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-12 19:00:09,985 INFO [RS:1;jenkins-hbase20:38579] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-12 19:00:09,985 INFO [RS:0;jenkins-hbase20:42275] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-12 19:00:09,987 INFO [RS:0;jenkins-hbase20:42275] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,42275,1694545208517-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,987 INFO [RS:2;jenkins-hbase20:36759] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,36759,1694545208602-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:09,987 INFO [RS:1;jenkins-hbase20:38579] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38579,1694545208565-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:10,009 INFO [RS:1;jenkins-hbase20:38579] regionserver.Replication(203): jenkins-hbase20.apache.org,38579,1694545208565 started 2023-09-12 19:00:10,009 INFO [RS:2;jenkins-hbase20:36759] regionserver.Replication(203): jenkins-hbase20.apache.org,36759,1694545208602 started 2023-09-12 19:00:10,010 INFO [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,38579,1694545208565, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:38579, sessionid=0x1008d06ae340002 2023-09-12 19:00:10,010 INFO [RS:0;jenkins-hbase20:42275] regionserver.Replication(203): jenkins-hbase20.apache.org,42275,1694545208517 started 2023-09-12 19:00:10,010 INFO [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,36759,1694545208602, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:36759, sessionid=0x1008d06ae340003 2023-09-12 19:00:10,010 INFO [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(1637): Serving as jenkins-hbase20.apache.org,42275,1694545208517, RpcServer on jenkins-hbase20.apache.org/148.251.75.209:42275, sessionid=0x1008d06ae340001 2023-09-12 19:00:10,010 DEBUG [RS:2;jenkins-hbase20:36759] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-12 19:00:10,010 DEBUG [RS:0;jenkins-hbase20:42275] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-12 19:00:10,010 DEBUG [RS:1;jenkins-hbase20:38579] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-12 19:00:10,010 DEBUG [RS:0;jenkins-hbase20:42275] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:10,010 DEBUG [RS:2;jenkins-hbase20:36759] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:10,011 DEBUG [RS:0;jenkins-hbase20:42275] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42275,1694545208517' 2023-09-12 19:00:10,011 DEBUG [RS:1;jenkins-hbase20:38579] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:10,011 DEBUG [RS:0;jenkins-hbase20:42275] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-12 19:00:10,011 DEBUG [RS:2;jenkins-hbase20:36759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36759,1694545208602' 2023-09-12 19:00:10,011 DEBUG [RS:2;jenkins-hbase20:36759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-12 19:00:10,011 DEBUG [RS:1;jenkins-hbase20:38579] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38579,1694545208565' 2023-09-12 19:00:10,012 DEBUG [RS:1;jenkins-hbase20:38579] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-12 19:00:10,012 DEBUG [RS:0;jenkins-hbase20:42275] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-12 19:00:10,012 DEBUG [RS:2;jenkins-hbase20:36759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-12 19:00:10,012 DEBUG [RS:1;jenkins-hbase20:38579] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-12 19:00:10,012 DEBUG [RS:0;jenkins-hbase20:42275] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-12 19:00:10,013 DEBUG [RS:2;jenkins-hbase20:36759] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-12 19:00:10,013 DEBUG [RS:0;jenkins-hbase20:42275] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-12 19:00:10,013 DEBUG [RS:1;jenkins-hbase20:38579] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-12 19:00:10,013 DEBUG [RS:0;jenkins-hbase20:42275] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:10,013 DEBUG [RS:2;jenkins-hbase20:36759] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-12 19:00:10,013 DEBUG [RS:0;jenkins-hbase20:42275] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,42275,1694545208517' 2023-09-12 19:00:10,013 DEBUG [RS:1;jenkins-hbase20:38579] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-12 19:00:10,013 DEBUG [RS:0;jenkins-hbase20:42275] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:10,013 DEBUG [RS:2;jenkins-hbase20:36759] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:10,013 DEBUG [RS:1;jenkins-hbase20:38579] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:10,014 DEBUG [RS:1;jenkins-hbase20:38579] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,38579,1694545208565' 2023-09-12 19:00:10,014 DEBUG [RS:2;jenkins-hbase20:36759] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase20.apache.org,36759,1694545208602' 2023-09-12 19:00:10,014 DEBUG [RS:2;jenkins-hbase20:36759] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:10,014 DEBUG [RS:1;jenkins-hbase20:38579] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:10,014 DEBUG [RS:0;jenkins-hbase20:42275] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:10,014 DEBUG [RS:2;jenkins-hbase20:36759] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:10,014 DEBUG [RS:1;jenkins-hbase20:38579] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:10,014 DEBUG [RS:0;jenkins-hbase20:42275] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-12 19:00:10,015 INFO [RS:0;jenkins-hbase20:42275] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-12 19:00:10,015 INFO [RS:0;jenkins-hbase20:42275] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-12 19:00:10,015 DEBUG [RS:2;jenkins-hbase20:36759] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-12 19:00:10,015 DEBUG [RS:1;jenkins-hbase20:38579] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-12 19:00:10,015 INFO [RS:2;jenkins-hbase20:36759] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-12 19:00:10,016 INFO [RS:1;jenkins-hbase20:38579] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-12 19:00:10,016 INFO [RS:2;jenkins-hbase20:36759] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-12 19:00:10,016 INFO [RS:1;jenkins-hbase20:38579] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-12 19:00:10,096 DEBUG [jenkins-hbase20:38069] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-12 19:00:10,100 DEBUG [jenkins-hbase20:38069] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-12 19:00:10,106 DEBUG [jenkins-hbase20:38069] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 19:00:10,106 DEBUG [jenkins-hbase20:38069] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 19:00:10,106 DEBUG [jenkins-hbase20:38069] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 19:00:10,106 DEBUG [jenkins-hbase20:38069] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 19:00:10,109 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36759,1694545208602, state=OPENING 2023-09-12 19:00:10,115 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-12 19:00:10,116 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:00:10,117 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-12 19:00:10,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36759,1694545208602}] 2023-09-12 19:00:10,131 INFO [RS:0;jenkins-hbase20:42275] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C42275%2C1694545208517, suffix=, logDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,42275,1694545208517, archiveDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/oldWALs, maxLogs=32 2023-09-12 19:00:10,131 INFO [RS:2;jenkins-hbase20:36759] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36759%2C1694545208602, suffix=, logDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,36759,1694545208602, archiveDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/oldWALs, maxLogs=32 2023-09-12 19:00:10,134 INFO [RS:1;jenkins-hbase20:38579] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C38579%2C1694545208565, suffix=, logDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,38579,1694545208565, archiveDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/oldWALs, maxLogs=32 2023-09-12 19:00:10,158 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45005,DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39,DISK] 2023-09-12 19:00:10,158 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40247,DS-5b260b88-3cc6-4064-ab52-ec20e8711784,DISK] 2023-09-12 19:00:10,158 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33023,DS-6b87871f-3e57-4728-83ab-380102c98b59,DISK] 2023-09-12 19:00:10,174 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40247,DS-5b260b88-3cc6-4064-ab52-ec20e8711784,DISK] 2023-09-12 19:00:10,174 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33023,DS-6b87871f-3e57-4728-83ab-380102c98b59,DISK] 2023-09-12 19:00:10,174 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45005,DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39,DISK] 2023-09-12 19:00:10,180 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33023,DS-6b87871f-3e57-4728-83ab-380102c98b59,DISK] 2023-09-12 19:00:10,180 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40247,DS-5b260b88-3cc6-4064-ab52-ec20e8711784,DISK] 2023-09-12 19:00:10,180 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45005,DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39,DISK] 2023-09-12 19:00:10,181 INFO [RS:0;jenkins-hbase20:42275] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,42275,1694545208517/jenkins-hbase20.apache.org%2C42275%2C1694545208517.1694545210135 2023-09-12 19:00:10,187 DEBUG [RS:0;jenkins-hbase20:42275] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40247,DS-5b260b88-3cc6-4064-ab52-ec20e8711784,DISK], DatanodeInfoWithStorage[127.0.0.1:45005,DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39,DISK], DatanodeInfoWithStorage[127.0.0.1:33023,DS-6b87871f-3e57-4728-83ab-380102c98b59,DISK]] 2023-09-12 19:00:10,192 INFO [RS:1;jenkins-hbase20:38579] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,38579,1694545208565/jenkins-hbase20.apache.org%2C38579%2C1694545208565.1694545210136 2023-09-12 19:00:10,192 INFO [RS:2;jenkins-hbase20:36759] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,36759,1694545208602/jenkins-hbase20.apache.org%2C36759%2C1694545208602.1694545210135 2023-09-12 19:00:10,192 DEBUG [RS:1;jenkins-hbase20:38579] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45005,DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39,DISK], DatanodeInfoWithStorage[127.0.0.1:33023,DS-6b87871f-3e57-4728-83ab-380102c98b59,DISK], DatanodeInfoWithStorage[127.0.0.1:40247,DS-5b260b88-3cc6-4064-ab52-ec20e8711784,DISK]] 2023-09-12 19:00:10,194 DEBUG [RS:2;jenkins-hbase20:36759] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33023,DS-6b87871f-3e57-4728-83ab-380102c98b59,DISK], DatanodeInfoWithStorage[127.0.0.1:45005,DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39,DISK], DatanodeInfoWithStorage[127.0.0.1:40247,DS-5b260b88-3cc6-4064-ab52-ec20e8711784,DISK]] 2023-09-12 19:00:10,308 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:10,318 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 19:00:10,322 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 19:00:10,335 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-12 19:00:10,335 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-12 19:00:10,338 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase20.apache.org%2C36759%2C1694545208602.meta, suffix=.meta, logDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,36759,1694545208602, archiveDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/oldWALs, maxLogs=32 2023-09-12 19:00:10,357 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45005,DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39,DISK] 2023-09-12 19:00:10,357 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33023,DS-6b87871f-3e57-4728-83ab-380102c98b59,DISK] 2023-09-12 19:00:10,357 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40247,DS-5b260b88-3cc6-4064-ab52-ec20e8711784,DISK] 2023-09-12 19:00:10,364 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,36759,1694545208602/jenkins-hbase20.apache.org%2C36759%2C1694545208602.meta.1694545210340.meta 2023-09-12 19:00:10,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45005,DS-a3f5e5b8-fdfc-4164-9120-651ee1fbcb39,DISK], DatanodeInfoWithStorage[127.0.0.1:40247,DS-5b260b88-3cc6-4064-ab52-ec20e8711784,DISK], DatanodeInfoWithStorage[127.0.0.1:33023,DS-6b87871f-3e57-4728-83ab-380102c98b59,DISK]] 2023-09-12 19:00:10,365 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-12 19:00:10,366 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-12 19:00:10,367 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:10,368 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-12 19:00:10,370 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-12 19:00:10,372 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-12 19:00:10,384 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-12 19:00:10,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:10,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-12 19:00:10,385 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-12 19:00:10,388 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-12 19:00:10,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/info 2023-09-12 19:00:10,390 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/info 2023-09-12 19:00:10,391 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-12 19:00:10,392 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:10,392 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-12 19:00:10,394 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/rep_barrier 2023-09-12 19:00:10,394 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/rep_barrier 2023-09-12 19:00:10,395 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-12 19:00:10,396 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:10,396 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-12 19:00:10,397 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/table 2023-09-12 19:00:10,398 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/table 2023-09-12 19:00:10,398 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-12 19:00:10,399 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:10,402 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740 2023-09-12 19:00:10,405 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740 2023-09-12 19:00:10,408 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-12 19:00:10,410 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-12 19:00:10,412 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69879151, jitterRate=0.04128049314022064}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-12 19:00:10,416 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-12 19:00:10,427 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1694545210301 2023-09-12 19:00:10,442 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-12 19:00:10,443 INFO [RS_OPEN_META-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-12 19:00:10,444 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase20.apache.org,36759,1694545208602, state=OPEN 2023-09-12 19:00:10,447 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-12 19:00:10,447 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-12 19:00:10,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-12 19:00:10,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase20.apache.org,36759,1694545208602 in 327 msec 2023-09-12 19:00:10,458 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-12 19:00:10,459 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 532 msec 2023-09-12 19:00:10,464 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 825 msec 2023-09-12 19:00:10,464 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1694545210464, completionTime=-1 2023-09-12 19:00:10,464 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-12 19:00:10,465 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-12 19:00:10,523 DEBUG [hconnection-0x2aed008f-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:10,529 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44826, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:10,551 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-12 19:00:10,552 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1694545270552 2023-09-12 19:00:10,552 INFO [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1694545330552 2023-09-12 19:00:10,552 INFO [master/jenkins-hbase20:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 87 msec 2023-09-12 19:00:10,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38069,1694545207479-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:10,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38069,1694545207479-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:10,579 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38069,1694545207479-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:10,581 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase20:38069, period=300000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:10,581 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-12 19:00:10,591 DEBUG [master/jenkins-hbase20:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-12 19:00:10,599 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-12 19:00:10,600 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-12 19:00:10,609 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-12 19:00:10,611 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 19:00:10,615 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 19:00:10,661 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:00:10,665 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6 empty. 2023-09-12 19:00:10,666 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:00:10,666 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-12 19:00:10,703 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-12 19:00:10,705 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => e250f039a5cf7dd4c858fc6f38beccf6, NAME => 'hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:00:10,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:10,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing e250f039a5cf7dd4c858fc6f38beccf6, disabling compactions & flushes 2023-09-12 19:00:10,726 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:00:10,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:00:10,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. after waiting 0 ms 2023-09-12 19:00:10,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:00:10,726 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:00:10,726 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for e250f039a5cf7dd4c858fc6f38beccf6: 2023-09-12 19:00:10,731 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 19:00:10,745 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694545210734"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545210734"}]},"ts":"1694545210734"} 2023-09-12 19:00:10,772 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-12 19:00:10,774 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 19:00:10,778 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545210774"}]},"ts":"1694545210774"} 2023-09-12 19:00:10,782 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-12 19:00:10,785 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-12 19:00:10,786 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 19:00:10,787 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 19:00:10,787 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 19:00:10,787 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 19:00:10,789 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e250f039a5cf7dd4c858fc6f38beccf6, ASSIGN}] 2023-09-12 19:00:10,792 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=e250f039a5cf7dd4c858fc6f38beccf6, ASSIGN 2023-09-12 19:00:10,794 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=e250f039a5cf7dd4c858fc6f38beccf6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36759,1694545208602; forceNewPlan=false, retain=false 2023-09-12 19:00:10,945 INFO [jenkins-hbase20:38069] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-12 19:00:10,947 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e250f039a5cf7dd4c858fc6f38beccf6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:10,947 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694545210946"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545210946"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545210946"}]},"ts":"1694545210946"} 2023-09-12 19:00:10,951 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure e250f039a5cf7dd4c858fc6f38beccf6, server=jenkins-hbase20.apache.org,36759,1694545208602}] 2023-09-12 19:00:11,114 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:00:11,116 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e250f039a5cf7dd4c858fc6f38beccf6, NAME => 'hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6.', STARTKEY => '', ENDKEY => ''} 2023-09-12 19:00:11,116 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. service=AccessControlService 2023-09-12 19:00:11,117 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:11,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:00:11,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:11,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:00:11,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:00:11,120 INFO [StoreOpener-e250f039a5cf7dd4c858fc6f38beccf6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:00:11,123 DEBUG [StoreOpener-e250f039a5cf7dd4c858fc6f38beccf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6/info 2023-09-12 19:00:11,123 DEBUG [StoreOpener-e250f039a5cf7dd4c858fc6f38beccf6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6/info 2023-09-12 19:00:11,124 INFO [StoreOpener-e250f039a5cf7dd4c858fc6f38beccf6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e250f039a5cf7dd4c858fc6f38beccf6 columnFamilyName info 2023-09-12 19:00:11,125 INFO [StoreOpener-e250f039a5cf7dd4c858fc6f38beccf6-1] regionserver.HStore(310): Store=e250f039a5cf7dd4c858fc6f38beccf6/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:11,127 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:00:11,128 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:00:11,133 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:00:11,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:00:11,138 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened e250f039a5cf7dd4c858fc6f38beccf6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66827597, jitterRate=-0.004191204905509949}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:00:11,138 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for e250f039a5cf7dd4c858fc6f38beccf6: 2023-09-12 19:00:11,140 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6., pid=6, masterSystemTime=1694545211105 2023-09-12 19:00:11,143 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:00:11,144 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:00:11,145 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=e250f039a5cf7dd4c858fc6f38beccf6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:11,145 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1694545211144"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545211144"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545211144"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545211144"}]},"ts":"1694545211144"} 2023-09-12 19:00:11,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-12 19:00:11,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure e250f039a5cf7dd4c858fc6f38beccf6, server=jenkins-hbase20.apache.org,36759,1694545208602 in 198 msec 2023-09-12 19:00:11,156 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-12 19:00:11,157 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=e250f039a5cf7dd4c858fc6f38beccf6, ASSIGN in 363 msec 2023-09-12 19:00:11,159 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 19:00:11,159 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545211159"}]},"ts":"1694545211159"} 2023-09-12 19:00:11,161 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-12 19:00:11,164 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 19:00:11,167 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 564 msec 2023-09-12 19:00:11,211 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-12 19:00:11,212 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-12 19:00:11,213 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:00:11,244 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-12 19:00:11,260 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-12 19:00:11,265 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2023-09-12 19:00:11,278 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-12 19:00:11,289 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-12 19:00:11,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2023-09-12 19:00:11,303 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-12 19:00:11,305 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-12 19:00:11,305 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.642sec 2023-09-12 19:00:11,308 INFO [master/jenkins-hbase20:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-12 19:00:11,310 INFO [master/jenkins-hbase20:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-12 19:00:11,310 INFO [master/jenkins-hbase20:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-12 19:00:11,311 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38069,1694545207479-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-12 19:00:11,312 INFO [master/jenkins-hbase20:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase20.apache.org,38069,1694545207479-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-12 19:00:11,329 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-12 19:00:11,331 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-12 19:00:11,333 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 19:00:11,334 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 19:00:11,337 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:00:11,338 INFO [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-12 19:00:11,338 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea empty. 2023-09-12 19:00:11,338 DEBUG [Listener at localhost/33845] zookeeper.ReadOnlyZKClient(139): Connect 0x50cb261a to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:11,341 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:00:11,341 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-12 19:00:11,349 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-12 19:00:11,350 DEBUG [Listener at localhost/33845] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cdde26f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:11,371 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-12 19:00:11,373 DEBUG [hconnection-0xbc10edd-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:11,373 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 28744e05aa0ec1711fa3194b8c97dcea, NAME => 'hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:00:11,395 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:44828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:11,399 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:11,400 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 28744e05aa0ec1711fa3194b8c97dcea, disabling compactions & flushes 2023-09-12 19:00:11,400 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:00:11,400 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:00:11,400 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. after waiting 0 ms 2023-09-12 19:00:11,400 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:00:11,400 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase20.apache.org,38069,1694545207479 2023-09-12 19:00:11,400 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:00:11,400 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-12 19:00:11,400 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 28744e05aa0ec1711fa3194b8c97dcea: 2023-09-12 19:00:11,400 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/test.cache.data in system properties and HBase conf 2023-09-12 19:00:11,401 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop.tmp.dir in system properties and HBase conf 2023-09-12 19:00:11,401 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop.log.dir in system properties and HBase conf 2023-09-12 19:00:11,401 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-12 19:00:11,401 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-12 19:00:11,401 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/nfs.dump.dir in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/java.io.tmpdir in system properties and HBase conf 2023-09-12 19:00:11,402 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-12 19:00:11,403 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-12 19:00:11,403 INFO [Listener at localhost/33845] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-12 19:00:11,405 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 19:00:11,406 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694545211406"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545211406"}]},"ts":"1694545211406"} 2023-09-12 19:00:11,409 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-12 19:00:11,411 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 19:00:11,412 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545211412"}]},"ts":"1694545211412"} 2023-09-12 19:00:11,415 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-12 19:00:11,419 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-12 19:00:11,420 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 19:00:11,420 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 19:00:11,420 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 19:00:11,420 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 19:00:11,421 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=28744e05aa0ec1711fa3194b8c97dcea, ASSIGN}] 2023-09-12 19:00:11,424 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=28744e05aa0ec1711fa3194b8c97dcea, ASSIGN 2023-09-12 19:00:11,425 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=28744e05aa0ec1711fa3194b8c97dcea, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38579,1694545208565; forceNewPlan=false, retain=false 2023-09-12 19:00:11,452 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-12 19:00:11,576 INFO [jenkins-hbase20:38069] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-12 19:00:11,578 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=28744e05aa0ec1711fa3194b8c97dcea, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:11,578 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694545211577"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545211577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545211577"}]},"ts":"1694545211577"} 2023-09-12 19:00:11,581 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 28744e05aa0ec1711fa3194b8c97dcea, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:00:11,653 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-12 19:00:11,736 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:11,736 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 19:00:11,740 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 19:00:11,746 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:00:11,746 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 28744e05aa0ec1711fa3194b8c97dcea, NAME => 'hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea.', STARTKEY => '', ENDKEY => ''} 2023-09-12 19:00:11,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. service=AccessControlService 2023-09-12 19:00:11,747 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:11,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:00:11,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:11,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:00:11,747 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:00:11,749 INFO [StoreOpener-28744e05aa0ec1711fa3194b8c97dcea-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:00:11,752 DEBUG [StoreOpener-28744e05aa0ec1711fa3194b8c97dcea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea/l 2023-09-12 19:00:11,752 DEBUG [StoreOpener-28744e05aa0ec1711fa3194b8c97dcea-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea/l 2023-09-12 19:00:11,753 INFO [StoreOpener-28744e05aa0ec1711fa3194b8c97dcea-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28744e05aa0ec1711fa3194b8c97dcea columnFamilyName l 2023-09-12 19:00:11,754 INFO [StoreOpener-28744e05aa0ec1711fa3194b8c97dcea-1] regionserver.HStore(310): Store=28744e05aa0ec1711fa3194b8c97dcea/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:11,757 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:00:11,759 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:00:11,765 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:00:11,770 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:00:11,771 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 28744e05aa0ec1711fa3194b8c97dcea; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60319339, jitterRate=-0.10117180645465851}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:00:11,771 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 28744e05aa0ec1711fa3194b8c97dcea: 2023-09-12 19:00:11,775 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea., pid=11, masterSystemTime=1694545211736 2023-09-12 19:00:11,779 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:00:11,780 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:00:11,781 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=28744e05aa0ec1711fa3194b8c97dcea, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:11,782 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1694545211781"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545211781"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545211781"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545211781"}]},"ts":"1694545211781"} 2023-09-12 19:00:11,788 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-12 19:00:11,789 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 28744e05aa0ec1711fa3194b8c97dcea, server=jenkins-hbase20.apache.org,38579,1694545208565 in 203 msec 2023-09-12 19:00:11,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-12 19:00:11,792 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=28744e05aa0ec1711fa3194b8c97dcea, ASSIGN in 368 msec 2023-09-12 19:00:11,794 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 19:00:11,794 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545211794"}]},"ts":"1694545211794"} 2023-09-12 19:00:11,797 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-12 19:00:11,799 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 19:00:11,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 471 msec 2023-09-12 19:00:11,953 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-12 19:00:11,953 INFO [master/jenkins-hbase20:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-12 19:00:11,963 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-12 19:00:12,473 WARN [Thread-383] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 19:00:12,768 INFO [Thread-383] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 19:00:12,774 INFO [Thread-383] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_40695_jobhistory____.dgircd/webapp 2023-09-12 19:00:12,908 INFO [Thread-383] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-12 19:00:12,908 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-12 19:00:12,908 INFO [Thread-383] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-12 19:00:12,911 INFO [Thread-383] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-12 19:00:12,984 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:13,248 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:13,560 INFO [Thread-383] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-12 19:00:13,591 INFO [Thread-383] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:40695 2023-09-12 19:00:13,966 WARN [Listener at jenkins-hbase20.apache.org/34963] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 19:00:14,198 WARN [Listener at jenkins-hbase20.apache.org/34963] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-12 19:00:14,199 INFO [Listener at jenkins-hbase20.apache.org/34963] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 19:00:14,207 INFO [Listener at jenkins-hbase20.apache.org/34963] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_42515_cluster____.f8tlpn/webapp 2023-09-12 19:00:14,264 INFO [Listener at jenkins-hbase20.apache.org/34963] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-12 19:00:14,264 INFO [Listener at jenkins-hbase20.apache.org/34963] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-12 19:00:14,264 INFO [Listener at jenkins-hbase20.apache.org/34963] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-12 19:00:14,264 INFO [Listener at jenkins-hbase20.apache.org/34963] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-12 19:00:14,272 INFO [Listener at jenkins-hbase20.apache.org/34963] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:14,461 INFO [Listener at jenkins-hbase20.apache.org/34963] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:14,585 INFO [Listener at jenkins-hbase20.apache.org/34963] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:14,595 INFO [Listener at jenkins-hbase20.apache.org/34963] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:42515 2023-09-12 19:00:15,053 WARN [Listener at jenkins-hbase20.apache.org/35747] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 19:00:15,082 WARN [Listener at jenkins-hbase20.apache.org/35747] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-12 19:00:15,082 INFO [Listener at jenkins-hbase20.apache.org/35747] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 19:00:15,088 INFO [Listener at jenkins-hbase20.apache.org/35747] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_34811_node____m7xmw9/webapp 2023-09-12 19:00:15,132 INFO [Listener at jenkins-hbase20.apache.org/35747] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-12 19:00:15,132 INFO [Listener at jenkins-hbase20.apache.org/35747] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-12 19:00:15,133 INFO [Listener at jenkins-hbase20.apache.org/35747] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-12 19:00:15,133 INFO [Listener at jenkins-hbase20.apache.org/35747] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-12 19:00:15,143 INFO [Listener at jenkins-hbase20.apache.org/35747] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:15,163 INFO [Listener at jenkins-hbase20.apache.org/35747] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:15,239 INFO [Listener at jenkins-hbase20.apache.org/35747] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:15,253 INFO [Listener at jenkins-hbase20.apache.org/35747] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:34811 2023-09-12 19:00:15,462 WARN [Listener at jenkins-hbase20.apache.org/37289] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-12 19:00:15,472 WARN [Listener at jenkins-hbase20.apache.org/37289] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-12 19:00:15,472 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): jetty-6.1.26 2023-09-12 19:00:15,479 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/java.io.tmpdir/Jetty_jenkins.hbase20_apache_org_33013_node____.f1m14s/webapp 2023-09-12 19:00:15,522 INFO [Listener at jenkins-hbase20.apache.org/37289] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-12 19:00:15,522 INFO [Listener at jenkins-hbase20.apache.org/37289] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-12 19:00:15,522 INFO [Listener at jenkins-hbase20.apache.org/37289] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-12 19:00:15,522 INFO [Listener at jenkins-hbase20.apache.org/37289] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-12 19:00:15,530 INFO [Listener at jenkins-hbase20.apache.org/37289] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:15,543 INFO [Listener at jenkins-hbase20.apache.org/37289] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:15,606 INFO [Listener at jenkins-hbase20.apache.org/37289] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-12 19:00:15,612 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:33013 2023-09-12 19:00:15,635 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-12 19:00:15,636 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:00:15,701 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=702, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=87, ProcessCount=164, AvailableMemoryMB=3051 2023-09-12 19:00:15,701 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=702 is superior to 500 2023-09-12 19:00:15,715 DEBUG [Listener at jenkins-hbase20.apache.org/37289] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-12 19:00:15,721 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-12 19:00:15,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 19:00:15,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-12 19:00:15,735 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 19:00:15,736 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-12 19:00:15,738 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 19:00:15,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-12 19:00:15,744 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:15,744 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:15,745 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f empty. 2023-09-12 19:00:15,745 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa empty. 2023-09-12 19:00:15,748 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:15,749 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:15,749 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-12 19:00:15,798 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-12 19:00:15,799 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5e4bdfbb2f8f0474ef256983372fb87f, NAME => 'testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:00:15,800 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => fa20279287cced3534edbdfb561f60fa, NAME => 'testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:00:15,841 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:15,842 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-12 19:00:15,843 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 5e4bdfbb2f8f0474ef256983372fb87f, disabling compactions & flushes 2023-09-12 19:00:15,843 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:15,844 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:15,844 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. after waiting 0 ms 2023-09-12 19:00:15,844 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:15,844 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:15,844 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 5e4bdfbb2f8f0474ef256983372fb87f: 2023-09-12 19:00:15,847 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:15,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing fa20279287cced3534edbdfb561f60fa, disabling compactions & flushes 2023-09-12 19:00:15,848 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:15,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:15,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. after waiting 0 ms 2023-09-12 19:00:15,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:15,848 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:15,848 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for fa20279287cced3534edbdfb561f60fa: 2023-09-12 19:00:15,855 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 19:00:15,856 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694545215856"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545215856"}]},"ts":"1694545215856"} 2023-09-12 19:00:15,857 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694545215856"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545215856"}]},"ts":"1694545215856"} 2023-09-12 19:00:15,897 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 19:00:15,898 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 19:00:15,899 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545215898"}]},"ts":"1694545215898"} 2023-09-12 19:00:15,901 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-12 19:00:15,904 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-12 19:00:15,906 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 19:00:15,906 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 19:00:15,906 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 19:00:15,906 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 19:00:15,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e4bdfbb2f8f0474ef256983372fb87f, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa20279287cced3534edbdfb561f60fa, ASSIGN}] 2023-09-12 19:00:15,909 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e4bdfbb2f8f0474ef256983372fb87f, ASSIGN 2023-09-12 19:00:15,909 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa20279287cced3534edbdfb561f60fa, ASSIGN 2023-09-12 19:00:15,910 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa20279287cced3534edbdfb561f60fa, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36759,1694545208602; forceNewPlan=false, retain=false 2023-09-12 19:00:15,910 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e4bdfbb2f8f0474ef256983372fb87f, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42275,1694545208517; forceNewPlan=false, retain=false 2023-09-12 19:00:15,949 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 19:00:16,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-12 19:00:16,060 INFO [jenkins-hbase20:38069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 19:00:16,066 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fa20279287cced3534edbdfb561f60fa, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:16,066 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5e4bdfbb2f8f0474ef256983372fb87f, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:16,067 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694545216066"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545216066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545216066"}]},"ts":"1694545216066"} 2023-09-12 19:00:16,067 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694545216066"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545216066"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545216066"}]},"ts":"1694545216066"} 2023-09-12 19:00:16,069 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure fa20279287cced3534edbdfb561f60fa, server=jenkins-hbase20.apache.org,36759,1694545208602}] 2023-09-12 19:00:16,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 5e4bdfbb2f8f0474ef256983372fb87f, server=jenkins-hbase20.apache.org,42275,1694545208517}] 2023-09-12 19:00:16,097 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-12 19:00:16,099 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-12 19:00:16,100 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-12 19:00:16,225 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:16,226 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 19:00:16,230 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33048, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 19:00:16,231 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:16,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa20279287cced3534edbdfb561f60fa, NAME => 'testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 19:00:16,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. service=AccessControlService 2023-09-12 19:00:16,232 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:16,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:16,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:16,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:16,233 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:16,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5e4bdfbb2f8f0474ef256983372fb87f, NAME => 'testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 19:00:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. service=AccessControlService 2023-09-12 19:00:16,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:16,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:16,237 INFO [StoreOpener-fa20279287cced3534edbdfb561f60fa-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:16,239 INFO [StoreOpener-5e4bdfbb2f8f0474ef256983372fb87f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:16,240 DEBUG [StoreOpener-fa20279287cced3534edbdfb561f60fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/cf 2023-09-12 19:00:16,240 DEBUG [StoreOpener-fa20279287cced3534edbdfb561f60fa-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/cf 2023-09-12 19:00:16,241 DEBUG [StoreOpener-5e4bdfbb2f8f0474ef256983372fb87f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/cf 2023-09-12 19:00:16,241 DEBUG [StoreOpener-5e4bdfbb2f8f0474ef256983372fb87f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/cf 2023-09-12 19:00:16,243 INFO [StoreOpener-fa20279287cced3534edbdfb561f60fa-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa20279287cced3534edbdfb561f60fa columnFamilyName cf 2023-09-12 19:00:16,243 INFO [StoreOpener-5e4bdfbb2f8f0474ef256983372fb87f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5e4bdfbb2f8f0474ef256983372fb87f columnFamilyName cf 2023-09-12 19:00:16,246 INFO [StoreOpener-5e4bdfbb2f8f0474ef256983372fb87f-1] regionserver.HStore(310): Store=5e4bdfbb2f8f0474ef256983372fb87f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:16,246 INFO [StoreOpener-fa20279287cced3534edbdfb561f60fa-1] regionserver.HStore(310): Store=fa20279287cced3534edbdfb561f60fa/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:16,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:16,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:16,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:16,250 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:16,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:16,254 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:16,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:00:16,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:00:16,271 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened fa20279287cced3534edbdfb561f60fa; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69057904, jitterRate=0.029042959213256836}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:00:16,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for fa20279287cced3534edbdfb561f60fa: 2023-09-12 19:00:16,272 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 5e4bdfbb2f8f0474ef256983372fb87f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74251757, jitterRate=0.10643739998340607}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:00:16,272 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 5e4bdfbb2f8f0474ef256983372fb87f: 2023-09-12 19:00:16,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa., pid=15, masterSystemTime=1694545216222 2023-09-12 19:00:16,273 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f., pid=16, masterSystemTime=1694545216225 2023-09-12 19:00:16,277 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:16,278 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:16,278 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=fa20279287cced3534edbdfb561f60fa, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:16,279 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694545216278"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545216278"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545216278"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545216278"}]},"ts":"1694545216278"} 2023-09-12 19:00:16,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:16,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:16,282 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=5e4bdfbb2f8f0474ef256983372fb87f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:16,285 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694545216282"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545216282"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545216282"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545216282"}]},"ts":"1694545216282"} 2023-09-12 19:00:16,290 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=14 2023-09-12 19:00:16,291 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure fa20279287cced3534edbdfb561f60fa, server=jenkins-hbase20.apache.org,36759,1694545208602 in 217 msec 2023-09-12 19:00:16,292 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=13 2023-09-12 19:00:16,294 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 5e4bdfbb2f8f0474ef256983372fb87f, server=jenkins-hbase20.apache.org,42275,1694545208517 in 218 msec 2023-09-12 19:00:16,294 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa20279287cced3534edbdfb561f60fa, ASSIGN in 385 msec 2023-09-12 19:00:16,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-12 19:00:16,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e4bdfbb2f8f0474ef256983372fb87f, ASSIGN in 388 msec 2023-09-12 19:00:16,298 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 19:00:16,298 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545216298"}]},"ts":"1694545216298"} 2023-09-12 19:00:16,301 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-12 19:00:16,303 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 19:00:16,307 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-12 19:00:16,313 DEBUG [PEWorker-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:16,317 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:16,321 DEBUG [hconnection-0xe4f621f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:16,324 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-09-12 19:00:16,332 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-12 19:00:16,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-12 19:00:16,358 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:16,358 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:16,358 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:16,358 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:16,358 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:00:16,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:16,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:16,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:16,365 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:16,367 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 636 msec 2023-09-12 19:00:16,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-12 19:00:16,849 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-12 19:00:16,853 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-12 19:00:16,854 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:16,857 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:00:16,882 DEBUG [hconnection-0xbc10edd-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:16,887 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33064, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:16,907 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 19:00:16,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545216907 (current time:1694545216907). 2023-09-12 19:00:16,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:00:16,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x5558c96b to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:16,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@24db2ef1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:16,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:16,917 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:16,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5558c96b to 127.0.0.1:53172 2023-09-12 19:00:16,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:16,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x0ce19f9b to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:16,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e85e3a7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:16,939 DEBUG [hconnection-0x2c7d5584-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:16,942 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:16,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:16,948 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39300, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:16,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ce19f9b to 127.0.0.1:53172 2023-09-12 19:00:16,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:16,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-12 19:00:16,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:00:16,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 19:00:16,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 19:00:16,991 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 19:00:16,992 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694545816992 2023-09-12 19:00:16,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 19:00:16,992 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-12 19:00:16,996 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 19:00:16,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 19:00:16,998 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 13 msec 2023-09-12 19:00:16,999 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 19:00:17,000 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694545817000 2023-09-12 19:00:17,000 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:00:17,000 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:00:17,025 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,025 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-12 19:00:17,025 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:17,027 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-12 19:00:17,027 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-12 19:00:17,027 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,027 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,029 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,029 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,030 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,030 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,030 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,030 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,031 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,031 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:00:17,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,031 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-12 19:00:17,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-12 19:00:17,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-12 19:00:17,031 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 19:00:17,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,032 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 19:00:17,034 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 19:00:17,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,040 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,040 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 19:00:17,040 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 19:00:17,040 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:17,040 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:17,041 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 19:00:17,040 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 19:00:17,042 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-12 19:00:17,042 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 19:00:17,042 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-12 19:00:17,042 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:17,043 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-12 19:00:17,044 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-12 19:00:17,044 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 19:00:17,044 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-12 19:00:17,044 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-12 19:00:17,046 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,046 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,046 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,046 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,047 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:17,047 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,047 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,047 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,047 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:17,047 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:17,047 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:17,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:17,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-12 19:00:17,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d648a6e[Count = 1] remaining members to acquire global barrier 2023-09-12 19:00:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:17,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:17,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-12 19:00:17,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d648a6e[Count = 0] remaining members to acquire global barrier 2023-09-12 19:00:17,051 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-12 19:00:17,051 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,054 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,054 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,054 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,054 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 19:00:17,054 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,054 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 19:00:17,054 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 19:00:17,054 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-12 19:00:17,054 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:00:17,054 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,054 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:00:17,055 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:17,055 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:17,055 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:17,056 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. started... 2023-09-12 19:00:17,057 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5e4bdfbb2f8f0474ef256983372fb87f: 2023-09-12 19:00:17,058 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,058 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:17,059 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:17,059 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:17,060 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. started... 2023-09-12 19:00:17,060 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 19:00:17,060 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:17,060 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-12 19:00:17,061 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fa20279287cced3534edbdfb561f60fa: 2023-09-12 19:00:17,061 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,065 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:17,065 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:17,068 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:00:17,068 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:00:17,101 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:17,102 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. completed. 2023-09-12 19:00:17,102 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:17,105 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:17,105 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:17,105 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,106 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-12 19:00:17,106 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:00:17,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-12 19:00:17,108 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,108 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 19:00:17,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:17,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:17,108 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:17,108 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-12 19:00:17,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:17,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:17,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:17,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,111 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. completed. 2023-09-12 19:00:17,111 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:00:17,111 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:17,111 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:17,112 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:17,112 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,112 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-12 19:00:17,112 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:00:17,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,113 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,113 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 19:00:17,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:17,113 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:17,113 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-12 19:00:17,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,42275,1694545208517': 2023-09-12 19:00:17,116 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-12 19:00:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:17,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:17,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,36759,1694545208602': 2023-09-12 19:00:17,124 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-12 19:00:17,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-12 19:00:17,124 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:00:17,124 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:00:17,124 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,124 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:00:17,127 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,127 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,127 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,127 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,128 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:17,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,129 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,129 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:17,131 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,131 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,132 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,132 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,144 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,144 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,144 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,144 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,144 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,144 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,144 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,144 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:17,144 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,144 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,144 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,146 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-12 19:00:17,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,144 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,146 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:00:17,146 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,146 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,146 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,146 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,146 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,146 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,147 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 19:00:17,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,168 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,217 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,219 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-12 19:00:17,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,219 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:17,220 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694545216992Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694545217165 (+173 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1694545217165Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1694545217166 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1694545217178 (+12 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1694545217204 (+26 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694545217219 (+15 ms) 2023-09-12 19:00:17,222 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 19:00:17,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 228 msec 2023-09-12 19:00:17,311 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:17,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-12 19:00:17,314 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:00:17,330 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42275] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:00:17,331 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36759] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:00:17,337 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-12 19:00:17,337 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:17,337 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:00:17,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 19:00:17,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545217355 (current time:1694545217355). 2023-09-12 19:00:17,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:00:17,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x50b03c2f to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:17,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4eeb6d61, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:17,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:17,368 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:17,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50b03c2f to 127.0.0.1:53172 2023-09-12 19:00:17,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:17,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x233ea277 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:17,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@723ea37b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:17,379 DEBUG [hconnection-0x67ab5838-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:17,383 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:55972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:17,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:17,391 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39312, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:17,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x233ea277 to 127.0.0.1:53172 2023-09-12 19:00:17,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:17,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-12 19:00:17,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:00:17,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 19:00:17,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 19:00:17,398 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 19:00:17,399 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1694545817399 2023-09-12 19:00:17,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-12 19:00:17,399 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-12 19:00:17,401 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:00:17,401 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:00:17,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 19:00:17,402 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-12 19:00:17,405 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 8 msec 2023-09-12 19:00:17,406 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 19:00:17,407 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1694545817407 2023-09-12 19:00:17,424 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-12 19:00:17,424 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-12 19:00:17,424 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:17,426 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-12 19:00:17,426 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-12 19:00:17,426 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,426 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,427 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,427 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,427 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,427 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,427 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,428 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,428 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,428 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,428 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:00:17,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,428 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-12 19:00:17,429 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 19:00:17,429 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 19:00:17,429 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:17,429 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-12 19:00:17,429 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:17,435 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-12 19:00:17,436 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 19:00:17,436 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-12 19:00:17,436 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-12 19:00:17,435 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 19:00:17,436 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-12 19:00:17,436 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-12 19:00:17,436 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:17,437 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-12 19:00:17,437 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-12 19:00:17,437 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-12 19:00:17,442 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,443 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,443 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,443 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:17,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:17,443 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,443 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,443 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:17,443 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,443 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:17,443 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,443 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:17,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:17,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:17,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 19:00:17,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:17,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-12 19:00:17,445 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@545e541d[Count = 1] remaining members to acquire global barrier 2023-09-12 19:00:17,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:17,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:17,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:17,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:17,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 19:00:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:17,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-12 19:00:17,448 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@545e541d[Count = 0] remaining members to acquire global barrier 2023-09-12 19:00:17,448 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-12 19:00:17,448 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,452 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,452 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,452 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,452 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 19:00:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,452 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,452 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,452 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 19:00:17,452 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:17,452 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:17,452 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-12 19:00:17,452 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,452 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,452 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:00:17,452 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:17,453 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:00:17,452 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-12 19:00:17,453 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. started... 2023-09-12 19:00:17,453 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5e4bdfbb2f8f0474ef256983372fb87f 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-12 19:00:17,459 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:17,459 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:17,459 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:17,459 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. started... 2023-09-12 19:00:17,459 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 19:00:17,459 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:17,459 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-12 19:00:17,460 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fa20279287cced3534edbdfb561f60fa 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-12 19:00:17,501 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:17,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-12 19:00:17,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:17,503 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:00:17,576 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091232d2cd929bcb441c98c7134f08deaff2 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091232d2cd929bcb441c98c7134f08deaff2 2023-09-12 19:00:17,576 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309120b9c2fc7841f49348283a06ed8279c04 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309120b9c2fc7841f49348283a06ed8279c04 2023-09-12 19:00:17,610 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/.tmp/cf/bdecffb118874373822c6994e3c359df 2023-09-12 19:00:17,611 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/.tmp/cf/58635e8d1dea4ca7beb6e4a0164abc79 2023-09-12 19:00:17,618 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:00:17,620 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-12 19:00:17,621 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:00:17,621 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-12 19:00:17,621 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-12 19:00:17,621 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-12 19:00:17,621 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:00:17,622 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-12 19:00:17,622 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-12 19:00:17,622 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-12 19:00:17,623 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/.tmp/cf/bdecffb118874373822c6994e3c359df as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/cf/bdecffb118874373822c6994e3c359df 2023-09-12 19:00:17,623 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/.tmp/cf/58635e8d1dea4ca7beb6e4a0164abc79 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/cf/58635e8d1dea4ca7beb6e4a0164abc79 2023-09-12 19:00:17,632 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/cf/bdecffb118874373822c6994e3c359df, entries=45, sequenceid=6, filesize=12.5 K 2023-09-12 19:00:17,633 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/cf/58635e8d1dea4ca7beb6e4a0164abc79, entries=5, sequenceid=6, filesize=5.7 K 2023-09-12 19:00:17,637 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 5e4bdfbb2f8f0474ef256983372fb87f in 184ms, sequenceid=6, compaction requested=false 2023-09-12 19:00:17,637 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for fa20279287cced3534edbdfb561f60fa in 178ms, sequenceid=6, compaction requested=false 2023-09-12 19:00:17,637 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-12 19:00:17,637 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-12 19:00:17,639 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5e4bdfbb2f8f0474ef256983372fb87f: 2023-09-12 19:00:17,639 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fa20279287cced3534edbdfb561f60fa: 2023-09-12 19:00:17,640 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-12 19:00:17,640 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-12 19:00:17,640 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:17,640 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:17,640 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/cf/58635e8d1dea4ca7beb6e4a0164abc79] hfiles 2023-09-12 19:00:17,640 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/cf/bdecffb118874373822c6994e3c359df] hfiles 2023-09-12 19:00:17,640 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/cf/58635e8d1dea4ca7beb6e4a0164abc79 for snapshot=snaptb0-testExportWithTargetName 2023-09-12 19:00:17,640 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/cf/bdecffb118874373822c6994e3c359df for snapshot=snaptb0-testExportWithTargetName 2023-09-12 19:00:17,669 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. completed. 2023-09-12 19:00:17,669 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:17,669 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. completed. 2023-09-12 19:00:17,670 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-12 19:00:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:00:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-12 19:00:17,670 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:00:17,671 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,671 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 19:00:17,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,671 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:17,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:17,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:17,673 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-12 19:00:17,673 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:17,673 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-12 19:00:17,671 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-12 19:00:17,671 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:17,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:17,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 19:00:17,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:17,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 19:00:17,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,36759,1694545208602': 2023-09-12 19:00:17,678 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-12 19:00:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:17,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 19:00:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:17,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 19:00:17,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase20.apache.org,42275,1694545208517': 2023-09-12 19:00:17,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-12 19:00:17,681 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-12 19:00:17,681 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:00:17,681 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:00:17,681 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-12 19:00:17,681 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:00:17,693 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:17,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:17,693 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,694 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 19:00:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,694 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 19:00:17,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,697 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,698 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:17,698 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-12 19:00:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,703 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:17,711 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,711 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,711 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,711 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,712 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,712 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,712 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:17,712 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:17,712 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:17,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-12 19:00:17,712 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,712 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-12 19:00:17,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-12 19:00:17,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:17,712 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:17,712 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,713 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,713 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:17,713 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,713 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:17,713 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:17,713 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-12 19:00:17,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-12 19:00:17,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:00:17,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,713 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,714 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:17,715 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:17,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309120b9c2fc7841f49348283a06ed8279c04, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091232d2cd929bcb441c98c7134f08deaff2] mob files 2023-09-12 19:00:17,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309120b9c2fc7841f49348283a06ed8279c04 2023-09-12 19:00:17,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091232d2cd929bcb441c98c7134f08deaff2 2023-09-12 19:00:17,734 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-12 19:00:17,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,790 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,791 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-12 19:00:17,791 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,792 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-12 19:00:17,792 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1694545217399Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1694545217734 (+335 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1694545217734Loading Region manifests for snaptb0-testExportWithTargetName at 1694545217734Writing data manifest for snaptb0-testExportWithTargetName at 1694545217739 (+5 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1694545217775 (+36 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1694545217791 (+16 ms) 2023-09-12 19:00:17,794 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-12 19:00:17,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 394 msec 2023-09-12 19:00:18,014 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:18,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-12 19:00:18,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:00:18,018 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545218018 2023-09-12 19:00:18,019 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36845, tgtDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545218018, rawTgtDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545218018, srcFsUri=hdfs://localhost:36845, srcDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:00:18,053 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:00:18,053 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1679672197_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545218018, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545218018/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-12 19:00:18,053 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0, snapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-12 19:00:18,074 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545218018/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-12 19:00:18,139 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,140 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,141 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,141 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,911 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-7488511253079341645.jar 2023-09-12 19:00:18,911 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,912 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,968 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-6354074030601321891.jar 2023-09-12 19:00:18,969 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,969 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,970 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,970 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,971 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,971 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:18,972 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 19:00:18,972 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 19:00:18,972 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 19:00:18,973 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 19:00:18,973 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 19:00:18,974 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 19:00:18,974 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 19:00:18,974 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 19:00:18,975 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 19:00:18,975 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 19:00:18,979 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:18,979 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:18,979 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:00:18,980 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:18,980 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:18,981 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:00:18,981 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:00:20,128 WARN [Listener at jenkins-hbase20.apache.org/37289] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 19:00:20,134 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-12 19:00:20,142 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-12 19:00:20,579 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:00:20,580 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:00:20,779 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0001_000001 (auth:SIMPLE) 2023-09-12 19:00:21,740 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 19:00:24,722 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0001_000001 (auth:SIMPLE) 2023-09-12 19:00:26,955 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0001_000001 (auth:SIMPLE) 2023-09-12 19:00:29,750 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0001_000001 (auth:SIMPLE) 2023-09-12 19:00:29,769 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1694545214673_0001_01_000002 is : 143 2023-09-12 19:00:31,012 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 19:00:31,016 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 19:00:31,027 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-12 19:00:31,028 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 19:00:31,028 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 19:00:31,029 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-12 19:00:31,029 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-12 19:00:31,029 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-12 19:00:31,030 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545218018/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545218018/.hbase-snapshot/testExportWithTargetName 2023-09-12 19:00:31,030 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545218018/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-12 19:00:31,030 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545218018/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-12 19:00:31,041 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-12 19:00:31,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportWithTargetName 2023-09-12 19:00:31,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-12 19:00:31,058 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545231058"}]},"ts":"1694545231058"} 2023-09-12 19:00:31,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-12 19:00:31,060 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-12 19:00:31,062 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-12 19:00:31,064 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e4bdfbb2f8f0474ef256983372fb87f, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa20279287cced3534edbdfb561f60fa, UNASSIGN}] 2023-09-12 19:00:31,066 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e4bdfbb2f8f0474ef256983372fb87f, UNASSIGN 2023-09-12 19:00:31,067 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa20279287cced3534edbdfb561f60fa, UNASSIGN 2023-09-12 19:00:31,068 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fa20279287cced3534edbdfb561f60fa, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:31,068 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5e4bdfbb2f8f0474ef256983372fb87f, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:31,068 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694545231068"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545231068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545231068"}]},"ts":"1694545231068"} 2023-09-12 19:00:31,068 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694545231068"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545231068"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545231068"}]},"ts":"1694545231068"} 2023-09-12 19:00:31,070 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 5e4bdfbb2f8f0474ef256983372fb87f, server=jenkins-hbase20.apache.org,42275,1694545208517}] 2023-09-12 19:00:31,072 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure fa20279287cced3534edbdfb561f60fa, server=jenkins-hbase20.apache.org,36759,1694545208602}] 2023-09-12 19:00:31,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-12 19:00:31,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:31,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:31,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing fa20279287cced3534edbdfb561f60fa, disabling compactions & flushes 2023-09-12 19:00:31,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 5e4bdfbb2f8f0474ef256983372fb87f, disabling compactions & flushes 2023-09-12 19:00:31,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:31,231 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:31,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:31,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. after waiting 0 ms 2023-09-12 19:00:31,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:31,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:31,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. after waiting 0 ms 2023-09-12 19:00:31,231 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:31,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:00:31,249 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:00:31,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:00:31,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:00:31,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa. 2023-09-12 19:00:31,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f. 2023-09-12 19:00:31,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for fa20279287cced3534edbdfb561f60fa: 2023-09-12 19:00:31,252 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 5e4bdfbb2f8f0474ef256983372fb87f: 2023-09-12 19:00:31,254 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:31,255 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=5e4bdfbb2f8f0474ef256983372fb87f, regionState=CLOSED 2023-09-12 19:00:31,255 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694545231254"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545231254"}]},"ts":"1694545231254"} 2023-09-12 19:00:31,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:31,256 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=fa20279287cced3534edbdfb561f60fa, regionState=CLOSED 2023-09-12 19:00:31,256 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1694545231255"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545231255"}]},"ts":"1694545231255"} 2023-09-12 19:00:31,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-12 19:00:31,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 5e4bdfbb2f8f0474ef256983372fb87f, server=jenkins-hbase20.apache.org,42275,1694545208517 in 186 msec 2023-09-12 19:00:31,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-12 19:00:31,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure fa20279287cced3534edbdfb561f60fa, server=jenkins-hbase20.apache.org,36759,1694545208602 in 185 msec 2023-09-12 19:00:31,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=5e4bdfbb2f8f0474ef256983372fb87f, UNASSIGN in 195 msec 2023-09-12 19:00:31,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-12 19:00:31,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=fa20279287cced3534edbdfb561f60fa, UNASSIGN in 196 msec 2023-09-12 19:00:31,263 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545231263"}]},"ts":"1694545231263"} 2023-09-12 19:00:31,265 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-12 19:00:31,266 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-12 19:00:31,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 220 msec 2023-09-12 19:00:31,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-12 19:00:31,362 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-12 19:00:31,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportWithTargetName 2023-09-12 19:00:31,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 19:00:31,375 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 19:00:31,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-12 19:00:31,377 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 19:00:31,381 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-12 19:00:31,383 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 19:00:31,383 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 19:00:31,383 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 19:00:31,384 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-12 19:00:31,384 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:31,384 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:31,384 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:31,384 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:31,384 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:31,384 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:31,384 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-12 19:00:31,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-12 19:00:31,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-12 19:00:31,385 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-12 19:00:31,385 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-12 19:00:31,385 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-12 19:00:31,385 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-12 19:00:31,385 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-12 19:00:31,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-12 19:00:31,388 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/recovered.edits] 2023-09-12 19:00:31,388 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/recovered.edits] 2023-09-12 19:00:31,395 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/cf/bdecffb118874373822c6994e3c359df to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/cf/bdecffb118874373822c6994e3c359df 2023-09-12 19:00:31,395 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/cf/58635e8d1dea4ca7beb6e4a0164abc79 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/cf/58635e8d1dea4ca7beb6e4a0164abc79 2023-09-12 19:00:31,399 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f/recovered.edits/9.seqid 2023-09-12 19:00:31,399 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa/recovered.edits/9.seqid 2023-09-12 19:00:31,400 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/fa20279287cced3534edbdfb561f60fa 2023-09-12 19:00:31,400 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportWithTargetName/5e4bdfbb2f8f0474ef256983372fb87f 2023-09-12 19:00:31,400 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-12 19:00:31,401 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-12 19:00:31,402 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-12 19:00:31,406 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309120b9c2fc7841f49348283a06ed8279c04 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202309120b9c2fc7841f49348283a06ed8279c04 2023-09-12 19:00:31,408 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091232d2cd929bcb441c98c7134f08deaff2 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e2023091232d2cd929bcb441c98c7134f08deaff2 2023-09-12 19:00:31,409 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-12 19:00:31,412 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 19:00:31,431 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-12 19:00:31,434 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-12 19:00:31,436 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 19:00:31,436 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-12 19:00:31,436 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545231436"}]},"ts":"9223372036854775807"} 2023-09-12 19:00:31,436 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545231436"}]},"ts":"9223372036854775807"} 2023-09-12 19:00:31,439 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 19:00:31,439 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 5e4bdfbb2f8f0474ef256983372fb87f, NAME => 'testtb-testExportWithTargetName,,1694545215728.5e4bdfbb2f8f0474ef256983372fb87f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fa20279287cced3534edbdfb561f60fa, NAME => 'testtb-testExportWithTargetName,1,1694545215728.fa20279287cced3534edbdfb561f60fa.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 19:00:31,439 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-12 19:00:31,439 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694545231439"}]},"ts":"9223372036854775807"} 2023-09-12 19:00:31,442 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-12 19:00:31,444 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-12 19:00:31,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-09-12 19:00:31,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-12 19:00:31,491 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-12 19:00:31,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-12 19:00:31,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-12 19:00:31,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportWithTargetName" 2023-09-12 19:00:31,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-12 19:00:31,545 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 702) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:35747 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1281 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:51928 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-236898352_1 at /127.0.0.1:51900 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-236898352_1 at /127.0.0.1:45670 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:45682 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:39141 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'JobHistoryServer' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:43413 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-3-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:37289 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=934 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=176 (was 87) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 164) - ProcessCount LEAK? -, AvailableMemoryMB=2277 (was 3051) 2023-09-12 19:00:31,546 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-12 19:00:31,561 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=934, MaxFileDescriptor=60000, SystemLoadAverage=176, ProcessCount=167, AvailableMemoryMB=2276 2023-09-12 19:00:31,562 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-12 19:00:31,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 19:00:31,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-12 19:00:31,569 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 19:00:31,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-12 19:00:31,572 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 19:00:31,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-12 19:00:31,575 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:31,575 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:31,576 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233 empty. 2023-09-12 19:00:31,576 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8 empty. 2023-09-12 19:00:31,576 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:31,576 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:31,577 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-12 19:00:31,589 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-12 19:00:31,590 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 728660dceb9d9bf5925b653d39fe2233, NAME => 'testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:00:31,590 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => ea6650acb04c1b7d48e604f816890bf8, NAME => 'testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:00:31,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:31,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing ea6650acb04c1b7d48e604f816890bf8, disabling compactions & flushes 2023-09-12 19:00:31,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:31,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:31,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. after waiting 0 ms 2023-09-12 19:00:31,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:31,607 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:31,607 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for ea6650acb04c1b7d48e604f816890bf8: 2023-09-12 19:00:31,609 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:31,610 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 728660dceb9d9bf5925b653d39fe2233, disabling compactions & flushes 2023-09-12 19:00:31,611 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:31,611 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:31,611 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. after waiting 0 ms 2023-09-12 19:00:31,611 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:31,611 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:31,611 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 728660dceb9d9bf5925b653d39fe2233: 2023-09-12 19:00:31,614 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 19:00:31,615 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694545231615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545231615"}]},"ts":"1694545231615"} 2023-09-12 19:00:31,615 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694545231615"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545231615"}]},"ts":"1694545231615"} 2023-09-12 19:00:31,618 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 19:00:31,619 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 19:00:31,620 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545231619"}]},"ts":"1694545231619"} 2023-09-12 19:00:31,621 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-12 19:00:31,623 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-12 19:00:31,624 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 19:00:31,624 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 19:00:31,625 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 19:00:31,625 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 19:00:31,625 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=728660dceb9d9bf5925b653d39fe2233, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea6650acb04c1b7d48e604f816890bf8, ASSIGN}] 2023-09-12 19:00:31,628 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea6650acb04c1b7d48e604f816890bf8, ASSIGN 2023-09-12 19:00:31,628 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=728660dceb9d9bf5925b653d39fe2233, ASSIGN 2023-09-12 19:00:31,629 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=728660dceb9d9bf5925b653d39fe2233, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42275,1694545208517; forceNewPlan=false, retain=false 2023-09-12 19:00:31,629 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea6650acb04c1b7d48e604f816890bf8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38579,1694545208565; forceNewPlan=false, retain=false 2023-09-12 19:00:31,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-12 19:00:31,779 INFO [jenkins-hbase20:38069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 19:00:31,782 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=728660dceb9d9bf5925b653d39fe2233, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:31,782 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ea6650acb04c1b7d48e604f816890bf8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:31,782 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694545231782"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545231782"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545231782"}]},"ts":"1694545231782"} 2023-09-12 19:00:31,783 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694545231782"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545231782"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545231782"}]},"ts":"1694545231782"} 2023-09-12 19:00:31,785 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 728660dceb9d9bf5925b653d39fe2233, server=jenkins-hbase20.apache.org,42275,1694545208517}] 2023-09-12 19:00:31,786 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure ea6650acb04c1b7d48e604f816890bf8, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:00:31,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-12 19:00:31,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:31,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:31,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ea6650acb04c1b7d48e604f816890bf8, NAME => 'testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 19:00:31,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 728660dceb9d9bf5925b653d39fe2233, NAME => 'testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 19:00:31,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. service=AccessControlService 2023-09-12 19:00:31,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:31,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:31,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. service=AccessControlService 2023-09-12 19:00:31,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:31,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:31,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:31,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:31,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:31,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:31,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:31,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:31,947 INFO [StoreOpener-ea6650acb04c1b7d48e604f816890bf8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:31,947 INFO [StoreOpener-728660dceb9d9bf5925b653d39fe2233-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:31,948 DEBUG [StoreOpener-728660dceb9d9bf5925b653d39fe2233-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/cf 2023-09-12 19:00:31,948 DEBUG [StoreOpener-ea6650acb04c1b7d48e604f816890bf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/cf 2023-09-12 19:00:31,948 DEBUG [StoreOpener-728660dceb9d9bf5925b653d39fe2233-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/cf 2023-09-12 19:00:31,948 DEBUG [StoreOpener-ea6650acb04c1b7d48e604f816890bf8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/cf 2023-09-12 19:00:31,949 INFO [StoreOpener-728660dceb9d9bf5925b653d39fe2233-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 728660dceb9d9bf5925b653d39fe2233 columnFamilyName cf 2023-09-12 19:00:31,949 INFO [StoreOpener-ea6650acb04c1b7d48e604f816890bf8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ea6650acb04c1b7d48e604f816890bf8 columnFamilyName cf 2023-09-12 19:00:31,950 INFO [StoreOpener-ea6650acb04c1b7d48e604f816890bf8-1] regionserver.HStore(310): Store=ea6650acb04c1b7d48e604f816890bf8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:31,950 INFO [StoreOpener-728660dceb9d9bf5925b653d39fe2233-1] regionserver.HStore(310): Store=728660dceb9d9bf5925b653d39fe2233/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:31,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:31,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:31,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:31,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:31,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:31,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:31,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:00:31,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:00:31,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ea6650acb04c1b7d48e604f816890bf8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61760658, jitterRate=-0.0796944797039032}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:00:31,958 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 728660dceb9d9bf5925b653d39fe2233; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70450018, jitterRate=0.04978707432746887}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:00:31,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ea6650acb04c1b7d48e604f816890bf8: 2023-09-12 19:00:31,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 728660dceb9d9bf5925b653d39fe2233: 2023-09-12 19:00:31,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8., pid=31, masterSystemTime=1694545231937 2023-09-12 19:00:31,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233., pid=30, masterSystemTime=1694545231937 2023-09-12 19:00:31,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:31,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:31,964 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=ea6650acb04c1b7d48e604f816890bf8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:31,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:31,964 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694545231963"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545231963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545231963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545231963"}]},"ts":"1694545231963"} 2023-09-12 19:00:31,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:31,965 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=728660dceb9d9bf5925b653d39fe2233, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:31,966 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694545231965"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545231965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545231965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545231965"}]},"ts":"1694545231965"} 2023-09-12 19:00:31,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=29 2023-09-12 19:00:31,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure ea6650acb04c1b7d48e604f816890bf8, server=jenkins-hbase20.apache.org,38579,1694545208565 in 186 msec 2023-09-12 19:00:31,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=28 2023-09-12 19:00:31,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 728660dceb9d9bf5925b653d39fe2233, server=jenkins-hbase20.apache.org,42275,1694545208517 in 190 msec 2023-09-12 19:00:31,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea6650acb04c1b7d48e604f816890bf8, ASSIGN in 355 msec 2023-09-12 19:00:31,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=28, resume processing ppid=27 2023-09-12 19:00:31,987 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=728660dceb9d9bf5925b653d39fe2233, ASSIGN in 358 msec 2023-09-12 19:00:31,988 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 19:00:31,988 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545231988"}]},"ts":"1694545231988"} 2023-09-12 19:00:31,990 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-12 19:00:32,012 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 19:00:32,012 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-12 19:00:32,015 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 19:00:32,160 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:32,160 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:32,160 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:32,160 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:32,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-12 19:00:32,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:32,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:32,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:32,283 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:32,285 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 718 msec 2023-09-12 19:00:32,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-12 19:00:32,678 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-12 19:00:32,682 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-12 19:00:32,682 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:32,683 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:00:32,696 DEBUG [hconnection-0xbc10edd-shared-pool-11] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:32,701 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:32,705 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:00:32,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545232706 (current time:1694545232706). 2023-09-12 19:00:32,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:00:32,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x1f37a63a to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:33,000 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66bea4d6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:33,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:33,005 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49186, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:33,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1f37a63a to 127.0.0.1:53172 2023-09-12 19:00:33,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:33,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x3210e7a1 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:33,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10b491af, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:33,650 DEBUG [hconnection-0x33f0f7b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:33,651 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:33,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:33,662 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:33,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3210e7a1 to 127.0.0.1:53172 2023-09-12 19:00:33,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:33,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 19:00:33,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:00:33,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:00:33,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:00:33,668 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:00:33,669 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694545833669 2023-09-12 19:00:33,669 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-12 19:00:33,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:00:33,671 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:00:33,671 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:00:33,672 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 19:00:33,673 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:00:33,675 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-12 19:00:33,676 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 19:00:33,677 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694545833677 2023-09-12 19:00:33,689 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:33,689 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-12 19:00:33,689 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:33,691 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-12 19:00:33,691 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-12 19:00:33,772 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:33,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:00:33,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:33,773 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:00:33,936 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:33,936 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:33,973 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:33,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:00:33,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:33,975 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-12 19:00:34,102 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-12 19:00:34,198 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:34,198 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:34,198 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:34,198 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:34,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:34,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:34,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:34,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:34,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:34,199 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,199 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,199 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,200 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 19:00:34,200 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,201 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 19:00:34,201 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 19:00:34,201 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:34,201 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 19:00:34,202 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 19:00:34,202 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-12 19:00:34,202 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:34,201 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:34,203 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 19:00:34,203 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-12 19:00:34,202 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-12 19:00:34,203 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-12 19:00:34,203 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 19:00:34,203 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-12 19:00:34,203 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-12 19:00:34,275 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:34,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:00:34,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:34,276 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-09-12 19:00:34,447 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,699 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,699 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,700 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:34,699 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,699 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:34,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:34,699 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,700 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,700 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:34,700 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:34,700 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:34,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-12 19:00:34,703 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@590d5d77[Count = 1] remaining members to acquire global barrier 2023-09-12 19:00:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:34,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-12 19:00:34,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@590d5d77[Count = 0] remaining members to acquire global barrier 2023-09-12 19:00:34,706 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-12 19:00:34,706 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,707 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,707 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,707 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,707 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:00:34,707 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,708 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:00:34,708 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:34,708 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:34,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,708 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. started... 2023-09-12 19:00:34,708 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:00:34,708 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:34,708 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-12 19:00:34,708 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 728660dceb9d9bf5925b653d39fe2233: 2023-09-12 19:00:34,708 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,708 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:00:34,708 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:00:34,708 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,709 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:34,709 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:00:34,710 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:34,710 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:34,710 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 19:00:34,710 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:34,710 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:34,710 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. started... 2023-09-12 19:00:34,710 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-12 19:00:34,713 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ea6650acb04c1b7d48e604f816890bf8: 2023-09-12 19:00:34,713 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,713 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:34,713 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:00:34,727 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. completed. 2023-09-12 19:00:34,727 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:34,727 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:34,727 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:34,727 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,727 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-12 19:00:34,727 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:00:34,728 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 19:00:34,728 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,728 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:34,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:34,729 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-12 19:00:34,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:34,730 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. completed. 2023-09-12 19:00:34,730 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:34,731 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:34,731 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:34,731 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,731 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-12 19:00:34,731 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:00:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,732 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,732 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 19:00:34,732 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:34,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,732 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-12 19:00:34,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:34,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,42275,1694545208517': 2023-09-12 19:00:34,735 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-12 19:00:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:34,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,38579,1694545208565': 2023-09-12 19:00:34,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-12 19:00:34,738 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-12 19:00:34,738 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:00:34,738 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:00:34,738 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,738 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:00:34,739 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,739 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,739 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,739 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,739 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:34,739 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:34,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,739 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,739 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:34,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:34,740 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:34,740 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,741 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:34,742 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,743 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,743 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:34,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:34,745 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:34,745 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:34,745 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:34,745 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,747 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-12 19:00:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:34,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:34,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,747 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:34,747 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:00:34,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:34,747 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,747 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:34,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:34,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:34,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:34,747 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:34,748 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,748 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,748 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 19:00:34,755 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,756 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,776 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:34,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:00:34,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:34,778 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-09-12 19:00:34,786 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,787 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-12 19:00:34,787 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,788 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:34,788 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694545233669Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694545234755 (+1086 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1694545234755Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1694545234755Writing data manifest for emptySnaptb0-testExportFileSystemState at 1694545234759 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1694545234775 (+16 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694545234787 (+12 ms) 2023-09-12 19:00:34,790 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 19:00:34,792 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 1.1190 sec 2023-09-12 19:00:35,778 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:35,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:00:35,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:00:35,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42275] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:00:35,788 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38579] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:00:35,793 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-12 19:00:35,793 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:35,793 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:00:35,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:00:35,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545235811 (current time:1694545235811). 2023-09-12 19:00:35,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:00:35,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x3f701511 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:35,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2eefee92, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:35,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:35,821 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:35,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3f701511 to 127.0.0.1:53172 2023-09-12 19:00:35,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:35,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x74ca3326 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:35,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ae794ba, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:35,831 DEBUG [hconnection-0x33d70c51-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:35,844 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49212, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:35,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:35,852 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:52994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:35,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74ca3326 to 127.0.0.1:53172 2023-09-12 19:00:35,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:35,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 19:00:35,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:00:35,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:00:35,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:00:35,859 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:00:35,860 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694545835860 2023-09-12 19:00:35,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:00:35,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-12 19:00:35,862 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:00:35,862 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:00:35,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 19:00:35,864 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:00:35,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 8 msec 2023-09-12 19:00:35,867 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 19:00:35,868 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694545835868 2023-09-12 19:00:35,890 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-12 19:00:35,890 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-12 19:00:35,890 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:35,891 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-12 19:00:35,891 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-12 19:00:35,892 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,892 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,893 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:35,893 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:35,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:35,893 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:35,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:35,893 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:35,893 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:35,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:35,894 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:35,894 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,894 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,894 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-12 19:00:35,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 19:00:35,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 19:00:35,895 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-12 19:00:35,895 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-12 19:00:35,895 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 19:00:35,895 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:35,898 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-12 19:00:35,899 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-12 19:00:35,899 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 19:00:35,900 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:35,899 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 19:00:35,901 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 19:00:35,901 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-12 19:00:35,901 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-12 19:00:35,899 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-12 19:00:35,901 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-12 19:00:35,901 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-12 19:00:35,901 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:35,903 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-12 19:00:35,903 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-12 19:00:35,903 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-12 19:00:35,909 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,909 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:35,909 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:35,909 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,909 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:35,909 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,909 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:35,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:35,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:35,909 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,909 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:35,909 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,910 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:35,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:35,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:35,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 19:00:35,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:35,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:35,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:35,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:35,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-12 19:00:35,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20438bc2[Count = 1] remaining members to acquire global barrier 2023-09-12 19:00:35,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:35,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:35,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:35,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:35,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:35,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 19:00:35,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:35,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:35,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:35,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:35,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-12 19:00:35,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@20438bc2[Count = 0] remaining members to acquire global barrier 2023-09-12 19:00:35,914 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-12 19:00:35,914 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,917 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,917 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,917 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,917 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:35,917 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:00:35,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:35,917 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:00:35,917 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:35,917 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:35,917 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:00:35,917 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:35,917 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-12 19:00:35,917 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:00:35,918 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. started... 2023-09-12 19:00:35,918 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:00:35,917 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:35,918 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:35,918 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:35,918 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:35,918 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. started... 2023-09-12 19:00:35,918 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ea6650acb04c1b7d48e604f816890bf8 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-12 19:00:35,918 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 728660dceb9d9bf5925b653d39fe2233 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-12 19:00:35,919 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 19:00:35,919 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:35,919 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-12 19:00:35,962 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:35,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:00:35,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:35,964 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:00:35,969 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091206c2e37c90e640a8b9f4da53f13d6413 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091206c2e37c90e640a8b9f4da53f13d6413 2023-09-12 19:00:35,976 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309126b66a0c215a3412cab5ffdb414c35520 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309126b66a0c215a3412cab5ffdb414c35520 2023-09-12 19:00:35,994 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/.tmp/cf/d9c11018739b47509f8e4b5f694756c1 2023-09-12 19:00:36,002 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0001_000001 (auth:SIMPLE) 2023-09-12 19:00:36,007 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/.tmp/cf/d9c11018739b47509f8e4b5f694756c1 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/cf/d9c11018739b47509f8e4b5f694756c1 2023-09-12 19:00:36,009 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/.tmp/cf/c64de6dbd5f342c5ae8d682cb0dd6390 2023-09-12 19:00:36,015 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/cf/d9c11018739b47509f8e4b5f694756c1, entries=49, sequenceid=6, filesize=13.2 K 2023-09-12 19:00:36,016 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/.tmp/cf/c64de6dbd5f342c5ae8d682cb0dd6390 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/cf/c64de6dbd5f342c5ae8d682cb0dd6390 2023-09-12 19:00:36,017 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for ea6650acb04c1b7d48e604f816890bf8 in 99ms, sequenceid=6, compaction requested=false 2023-09-12 19:00:36,019 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ea6650acb04c1b7d48e604f816890bf8: 2023-09-12 19:00:36,019 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-12 19:00:36,019 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:36,019 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/cf/d9c11018739b47509f8e4b5f694756c1] hfiles 2023-09-12 19:00:36,019 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/cf/d9c11018739b47509f8e4b5f694756c1 for snapshot=snaptb0-testExportFileSystemState 2023-09-12 19:00:36,026 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/cf/c64de6dbd5f342c5ae8d682cb0dd6390, entries=1, sequenceid=6, filesize=5.1 K 2023-09-12 19:00:36,028 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for 728660dceb9d9bf5925b653d39fe2233 in 110ms, sequenceid=6, compaction requested=false 2023-09-12 19:00:36,028 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 728660dceb9d9bf5925b653d39fe2233: 2023-09-12 19:00:36,028 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-12 19:00:36,028 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:36,028 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/cf/c64de6dbd5f342c5ae8d682cb0dd6390] hfiles 2023-09-12 19:00:36,028 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/cf/c64de6dbd5f342c5ae8d682cb0dd6390 for snapshot=snaptb0-testExportFileSystemState 2023-09-12 19:00:36,040 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. completed. 2023-09-12 19:00:36,040 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:36,040 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:36,040 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:36,040 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,041 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-12 19:00:36,041 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:00:36,083 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,083 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 19:00:36,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:36,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:36,083 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. completed. 2023-09-12 19:00:36,083 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:36,083 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:36,083 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-12 19:00:36,084 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:36,084 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:36,084 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:36,084 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-12 19:00:36,085 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:00:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:36,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 19:00:36,085 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,085 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-12 19:00:36,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:36,086 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:36,086 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-12 19:00:36,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:36,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 19:00:36,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:36,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,38579,1694545208565': 2023-09-12 19:00:36,089 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-12 19:00:36,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:36,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:36,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:36,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:36,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 19:00:36,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:36,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:36,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 19:00:36,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:36,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase20.apache.org,42275,1694545208517': 2023-09-12 19:00:36,092 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-12 19:00:36,092 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-12 19:00:36,092 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:00:36,092 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:00:36,092 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-12 19:00:36,092 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:00:36,102 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,102 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:36,102 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:36,102 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,102 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,102 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,102 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:36,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,102 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,102 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:36,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,103 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 19:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:36,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:36,103 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:36,103 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:36,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 19:00:36,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:36,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,105 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:36,105 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-12 19:00:36,105 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:36,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,110 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:36,110 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:36,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:36,110 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:36,110 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:36,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:36,110 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,110 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:36,111 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:36,110 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:36,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:36,110 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:36,111 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:36,111 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:36,111 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:36,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:36,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:36,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:36,111 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:36,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:36,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-12 19:00:36,112 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:36,112 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-12 19:00:36,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:36,112 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-12 19:00:36,112 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:36,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:00:36,112 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:36,113 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,113 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091206c2e37c90e640a8b9f4da53f13d6413, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309126b66a0c215a3412cab5ffdb414c35520] mob files 2023-09-12 19:00:36,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091206c2e37c90e640a8b9f4da53f13d6413 2023-09-12 19:00:36,114 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309126b66a0c215a3412cab5ffdb414c35520 2023-09-12 19:00:36,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-12 19:00:36,127 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,164 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:36,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:00:36,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:36,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,165 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-12 19:00:36,166 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-12 19:00:36,166 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,167 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1694545235860Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1694545236123 (+263 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1694545236123Loading Region manifests for snaptb0-testExportFileSystemState at 1694545236123Writing data manifest for snaptb0-testExportFileSystemState at 1694545236135 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1694545236148 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1694545236166 (+18 ms) 2023-09-12 19:00:36,169 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-12 19:00:36,172 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 308 msec 2023-09-12 19:00:36,466 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:36,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:00:36,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:00:36,467 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545236467 2023-09-12 19:00:36,468 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36845, tgtDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545236467, rawTgtDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545236467, srcFsUri=hdfs://localhost:36845, srcDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:00:36,490 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:00:36,490 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_434586084_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545236467, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545236467/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,490 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0, snapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-12 19:00:36,503 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545236467/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-12 19:00:36,538 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:36,539 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:36,540 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:36,540 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:36,831 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 19:00:37,347 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-7992233094450380175.jar 2023-09-12 19:00:37,348 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:37,348 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:37,403 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-2036236783307241438.jar 2023-09-12 19:00:37,403 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:37,403 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:37,404 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:37,404 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:37,404 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:37,405 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:37,405 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 19:00:37,405 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 19:00:37,406 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 19:00:37,406 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 19:00:37,406 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 19:00:37,407 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 19:00:37,407 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 19:00:37,407 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 19:00:37,407 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 19:00:37,408 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 19:00:37,408 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:37,409 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:37,409 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:00:37,409 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:37,409 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:37,410 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:00:37,410 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:00:37,864 WARN [Listener at jenkins-hbase20.apache.org/37289] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 19:00:37,866 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-12 19:00:37,869 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-12 19:00:37,931 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:00:37,932 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:00:37,997 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0002_000001 (auth:SIMPLE) 2023-09-12 19:00:41,333 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0002_000001 (auth:SIMPLE) 2023-09-12 19:00:43,534 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0002_000001 (auth:SIMPLE) 2023-09-12 19:00:46,328 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0002_000001 (auth:SIMPLE) 2023-09-12 19:00:48,068 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 19:00:48,069 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 19:00:48,076 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-12 19:00:48,076 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 19:00:48,077 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 19:00:48,077 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-12 19:00:48,077 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-12 19:00:48,077 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-12 19:00:48,077 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545236467/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545236467/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-12 19:00:48,078 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545236467/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-12 19:00:48,078 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545236467/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-12 19:00:48,084 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-12 19:00:48,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemState 2023-09-12 19:00:48,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-12 19:00:48,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-12 19:00:48,090 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545248090"}]},"ts":"1694545248090"} 2023-09-12 19:00:48,092 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-12 19:00:48,093 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-12 19:00:48,094 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=728660dceb9d9bf5925b653d39fe2233, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea6650acb04c1b7d48e604f816890bf8, UNASSIGN}] 2023-09-12 19:00:48,096 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea6650acb04c1b7d48e604f816890bf8, UNASSIGN 2023-09-12 19:00:48,097 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=728660dceb9d9bf5925b653d39fe2233, UNASSIGN 2023-09-12 19:00:48,098 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=728660dceb9d9bf5925b653d39fe2233, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:48,098 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ea6650acb04c1b7d48e604f816890bf8, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:48,098 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694545248097"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545248097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545248097"}]},"ts":"1694545248097"} 2023-09-12 19:00:48,098 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694545248097"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545248097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545248097"}]},"ts":"1694545248097"} 2023-09-12 19:00:48,099 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 728660dceb9d9bf5925b653d39fe2233, server=jenkins-hbase20.apache.org,42275,1694545208517}] 2023-09-12 19:00:48,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure ea6650acb04c1b7d48e604f816890bf8, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:00:48,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-12 19:00:48,252 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:48,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:48,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 728660dceb9d9bf5925b653d39fe2233, disabling compactions & flushes 2023-09-12 19:00:48,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:48,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ea6650acb04c1b7d48e604f816890bf8, disabling compactions & flushes 2023-09-12 19:00:48,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:48,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:48,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. after waiting 0 ms 2023-09-12 19:00:48,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:48,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:48,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. after waiting 0 ms 2023-09-12 19:00:48,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:48,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:00:48,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:00:48,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:00:48,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:00:48,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8. 2023-09-12 19:00:48,267 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233. 2023-09-12 19:00:48,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ea6650acb04c1b7d48e604f816890bf8: 2023-09-12 19:00:48,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 728660dceb9d9bf5925b653d39fe2233: 2023-09-12 19:00:48,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:48,270 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=728660dceb9d9bf5925b653d39fe2233, regionState=CLOSED 2023-09-12 19:00:48,270 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:48,270 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694545248270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545248270"}]},"ts":"1694545248270"} 2023-09-12 19:00:48,270 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=ea6650acb04c1b7d48e604f816890bf8, regionState=CLOSED 2023-09-12 19:00:48,271 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1694545248270"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545248270"}]},"ts":"1694545248270"} 2023-09-12 19:00:48,273 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-12 19:00:48,274 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 728660dceb9d9bf5925b653d39fe2233, server=jenkins-hbase20.apache.org,42275,1694545208517 in 173 msec 2023-09-12 19:00:48,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-12 19:00:48,274 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure ea6650acb04c1b7d48e604f816890bf8, server=jenkins-hbase20.apache.org,38579,1694545208565 in 172 msec 2023-09-12 19:00:48,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=728660dceb9d9bf5925b653d39fe2233, UNASSIGN in 180 msec 2023-09-12 19:00:48,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-12 19:00:48,276 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=ea6650acb04c1b7d48e604f816890bf8, UNASSIGN in 180 msec 2023-09-12 19:00:48,276 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545248276"}]},"ts":"1694545248276"} 2023-09-12 19:00:48,278 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-12 19:00:48,279 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-12 19:00:48,282 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 195 msec 2023-09-12 19:00:48,392 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-12 19:00:48,393 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-12 19:00:48,394 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemState 2023-09-12 19:00:48,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 19:00:48,400 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 19:00:48,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-12 19:00:48,402 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 19:00:48,404 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-12 19:00:48,406 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 19:00:48,406 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 19:00:48,406 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 19:00:48,406 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 19:00:48,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-12 19:00:48,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-12 19:00:48,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-12 19:00:48,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-12 19:00:48,408 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 19:00:48,408 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 19:00:48,408 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 19:00:48,408 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:48,408 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:48,408 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-12 19:00:48,408 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:48,408 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:48,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-12 19:00:48,410 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:48,410 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:48,413 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/recovered.edits] 2023-09-12 19:00:48,413 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/recovered.edits] 2023-09-12 19:00:48,418 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/cf/c64de6dbd5f342c5ae8d682cb0dd6390 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/cf/c64de6dbd5f342c5ae8d682cb0dd6390 2023-09-12 19:00:48,418 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/cf/d9c11018739b47509f8e4b5f694756c1 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/cf/d9c11018739b47509f8e4b5f694756c1 2023-09-12 19:00:48,421 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233/recovered.edits/9.seqid 2023-09-12 19:00:48,421 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8/recovered.edits/9.seqid 2023-09-12 19:00:48,422 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/728660dceb9d9bf5925b653d39fe2233 2023-09-12 19:00:48,422 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemState/ea6650acb04c1b7d48e604f816890bf8 2023-09-12 19:00:48,422 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-12 19:00:48,423 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-12 19:00:48,424 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-12 19:00:48,427 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091206c2e37c90e640a8b9f4da53f13d6413 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023091206c2e37c90e640a8b9f4da53f13d6413 2023-09-12 19:00:48,428 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309126b66a0c215a3412cab5ffdb414c35520 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e202309126b66a0c215a3412cab5ffdb414c35520 2023-09-12 19:00:48,428 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-12 19:00:48,431 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 19:00:48,433 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-12 19:00:48,436 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-12 19:00:48,437 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 19:00:48,437 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-12 19:00:48,437 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545248437"}]},"ts":"9223372036854775807"} 2023-09-12 19:00:48,437 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545248437"}]},"ts":"9223372036854775807"} 2023-09-12 19:00:48,439 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 19:00:48,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 728660dceb9d9bf5925b653d39fe2233, NAME => 'testtb-testExportFileSystemState,,1694545231563.728660dceb9d9bf5925b653d39fe2233.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ea6650acb04c1b7d48e604f816890bf8, NAME => 'testtb-testExportFileSystemState,1,1694545231563.ea6650acb04c1b7d48e604f816890bf8.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 19:00:48,440 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-12 19:00:48,440 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694545248440"}]},"ts":"9223372036854775807"} 2023-09-12 19:00:48,442 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-12 19:00:48,444 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-12 19:00:48,445 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 50 msec 2023-09-12 19:00:48,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-12 19:00:48,511 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-12 19:00:48,520 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-12 19:00:48,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-12 19:00:48,524 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemState" 2023-09-12 19:00:48,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-12 19:00:48,550 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=768 (was 755) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_434586084_17 at /127.0.0.1:52732 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:34868 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_733330457_1 at /127.0.0.1:32836 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:32860 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2081 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:34537 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_733330457_1 at /127.0.0.1:34846 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=941 (was 934) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=199 (was 176) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=2153 (was 2276) 2023-09-12 19:00:48,551 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-09-12 19:00:48,571 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=199, ProcessCount=167, AvailableMemoryMB=2153 2023-09-12 19:00:48,571 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-12 19:00:48,573 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 19:00:48,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-12 19:00:48,578 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 19:00:48,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-12 19:00:48,579 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 19:00:48,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-12 19:00:48,582 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37 2023-09-12 19:00:48,582 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:00:48,583 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37 empty. 2023-09-12 19:00:48,583 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8 empty. 2023-09-12 19:00:48,583 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37 2023-09-12 19:00:48,584 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:00:48,584 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-12 19:00:48,592 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-12 19:00:48,594 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2b8da1ed148e733ea84483703814ed37, NAME => 'testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:00:48,594 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2d5a429f251b328ccc3f9cfb9deb21f8, NAME => 'testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 2d5a429f251b328ccc3f9cfb9deb21f8, disabling compactions & flushes 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 2b8da1ed148e733ea84483703814ed37, disabling compactions & flushes 2023-09-12 19:00:48,610 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:48,610 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. after waiting 0 ms 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. after waiting 0 ms 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:48,610 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:48,610 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 2d5a429f251b328ccc3f9cfb9deb21f8: 2023-09-12 19:00:48,610 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 2b8da1ed148e733ea84483703814ed37: 2023-09-12 19:00:48,612 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 19:00:48,613 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694545248613"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545248613"}]},"ts":"1694545248613"} 2023-09-12 19:00:48,613 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694545248613"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545248613"}]},"ts":"1694545248613"} 2023-09-12 19:00:48,616 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 19:00:48,617 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 19:00:48,617 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545248617"}]},"ts":"1694545248617"} 2023-09-12 19:00:48,618 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-12 19:00:48,620 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-12 19:00:48,621 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 19:00:48,621 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 19:00:48,621 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 19:00:48,621 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 19:00:48,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b8da1ed148e733ea84483703814ed37, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2d5a429f251b328ccc3f9cfb9deb21f8, ASSIGN}] 2023-09-12 19:00:48,624 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2d5a429f251b328ccc3f9cfb9deb21f8, ASSIGN 2023-09-12 19:00:48,624 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b8da1ed148e733ea84483703814ed37, ASSIGN 2023-09-12 19:00:48,625 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b8da1ed148e733ea84483703814ed37, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42275,1694545208517; forceNewPlan=false, retain=false 2023-09-12 19:00:48,625 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2d5a429f251b328ccc3f9cfb9deb21f8, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38579,1694545208565; forceNewPlan=false, retain=false 2023-09-12 19:00:48,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-12 19:00:48,776 INFO [jenkins-hbase20:38069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 19:00:48,780 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2b8da1ed148e733ea84483703814ed37, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:48,780 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=2d5a429f251b328ccc3f9cfb9deb21f8, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:48,780 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694545248780"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545248780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545248780"}]},"ts":"1694545248780"} 2023-09-12 19:00:48,780 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694545248780"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545248780"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545248780"}]},"ts":"1694545248780"} 2023-09-12 19:00:48,783 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 2b8da1ed148e733ea84483703814ed37, server=jenkins-hbase20.apache.org,42275,1694545208517}] 2023-09-12 19:00:48,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 2d5a429f251b328ccc3f9cfb9deb21f8, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:00:48,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-12 19:00:48,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:48,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:48,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2b8da1ed148e733ea84483703814ed37, NAME => 'testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 19:00:48,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2d5a429f251b328ccc3f9cfb9deb21f8, NAME => 'testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 19:00:48,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. service=AccessControlService 2023-09-12 19:00:48,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. service=AccessControlService 2023-09-12 19:00:48,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:48,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:00:48,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 2b8da1ed148e733ea84483703814ed37 2023-09-12 19:00:48,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:00:48,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:48,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:00:48,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2b8da1ed148e733ea84483703814ed37 2023-09-12 19:00:48,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:00:48,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2b8da1ed148e733ea84483703814ed37 2023-09-12 19:00:48,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:00:48,950 INFO [StoreOpener-2d5a429f251b328ccc3f9cfb9deb21f8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:00:48,950 INFO [StoreOpener-2b8da1ed148e733ea84483703814ed37-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2b8da1ed148e733ea84483703814ed37 2023-09-12 19:00:48,951 DEBUG [StoreOpener-2d5a429f251b328ccc3f9cfb9deb21f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/cf 2023-09-12 19:00:48,951 DEBUG [StoreOpener-2b8da1ed148e733ea84483703814ed37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/cf 2023-09-12 19:00:48,951 DEBUG [StoreOpener-2b8da1ed148e733ea84483703814ed37-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/cf 2023-09-12 19:00:48,951 DEBUG [StoreOpener-2d5a429f251b328ccc3f9cfb9deb21f8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/cf 2023-09-12 19:00:48,952 INFO [StoreOpener-2d5a429f251b328ccc3f9cfb9deb21f8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2d5a429f251b328ccc3f9cfb9deb21f8 columnFamilyName cf 2023-09-12 19:00:48,952 INFO [StoreOpener-2b8da1ed148e733ea84483703814ed37-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2b8da1ed148e733ea84483703814ed37 columnFamilyName cf 2023-09-12 19:00:48,953 INFO [StoreOpener-2b8da1ed148e733ea84483703814ed37-1] regionserver.HStore(310): Store=2b8da1ed148e733ea84483703814ed37/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:48,953 INFO [StoreOpener-2d5a429f251b328ccc3f9cfb9deb21f8-1] regionserver.HStore(310): Store=2d5a429f251b328ccc3f9cfb9deb21f8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:00:48,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37 2023-09-12 19:00:48,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:00:48,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37 2023-09-12 19:00:48,955 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:00:48,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2b8da1ed148e733ea84483703814ed37 2023-09-12 19:00:48,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:00:48,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:00:48,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:00:48,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2b8da1ed148e733ea84483703814ed37; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69230003, jitterRate=0.031607434153556824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:00:48,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 2d5a429f251b328ccc3f9cfb9deb21f8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72190026, jitterRate=0.07571521401405334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:00:48,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2b8da1ed148e733ea84483703814ed37: 2023-09-12 19:00:48,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 2d5a429f251b328ccc3f9cfb9deb21f8: 2023-09-12 19:00:48,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8., pid=46, masterSystemTime=1694545248936 2023-09-12 19:00:48,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37., pid=45, masterSystemTime=1694545248936 2023-09-12 19:00:48,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:48,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:48,964 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=2b8da1ed148e733ea84483703814ed37, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:48,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:48,964 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694545248964"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545248964"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545248964"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545248964"}]},"ts":"1694545248964"} 2023-09-12 19:00:48,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:48,965 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=2d5a429f251b328ccc3f9cfb9deb21f8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:48,965 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694545248965"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545248965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545248965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545248965"}]},"ts":"1694545248965"} 2023-09-12 19:00:48,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-12 19:00:48,968 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 2b8da1ed148e733ea84483703814ed37, server=jenkins-hbase20.apache.org,42275,1694545208517 in 183 msec 2023-09-12 19:00:48,969 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b8da1ed148e733ea84483703814ed37, ASSIGN in 347 msec 2023-09-12 19:00:48,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-12 19:00:48,969 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 2d5a429f251b328ccc3f9cfb9deb21f8, server=jenkins-hbase20.apache.org,38579,1694545208565 in 183 msec 2023-09-12 19:00:48,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-12 19:00:48,971 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2d5a429f251b328ccc3f9cfb9deb21f8, ASSIGN in 348 msec 2023-09-12 19:00:48,972 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 19:00:48,972 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545248972"}]},"ts":"1694545248972"} 2023-09-12 19:00:48,973 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-12 19:00:48,975 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 19:00:48,975 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-12 19:00:48,977 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-12 19:00:48,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:48,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:48,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:48,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:00:48,979 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:48,979 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:48,979 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:48,979 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-12 19:00:48,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 405 msec 2023-09-12 19:00:49,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-12 19:00:49,186 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-12 19:00:49,189 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-12 19:00:49,189 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:49,191 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:00:49,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 19:00:49,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545249209 (current time:1694545249209). 2023-09-12 19:00:49,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:00:49,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x50bccf48 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:49,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e7d9290, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:49,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:49,224 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:49,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50bccf48 to 127.0.0.1:53172 2023-09-12 19:00:49,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:49,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x0468d96d to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:49,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32988027, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:49,237 DEBUG [hconnection-0x30736df6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:49,242 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49730, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:49,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:49,251 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41484, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:49,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0468d96d to 127.0.0.1:53172 2023-09-12 19:00:49,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:49,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-12 19:00:49,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:00:49,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 19:00:49,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 19:00:49,257 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 19:00:49,257 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694545849257 2023-09-12 19:00:49,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 19:00:49,257 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-12 19:00:49,259 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:00:49,259 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:00:49,261 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 19:00:49,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 19:00:49,262 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-12 19:00:49,263 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 19:00:49,264 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694545849264 2023-09-12 19:00:49,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,274 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-12 19:00:49,274 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:49,275 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-12 19:00:49,275 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-12 19:00:49,276 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,276 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,276 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,276 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,276 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,276 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,277 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,277 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,277 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,277 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:00:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,278 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 19:00:49,278 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 19:00:49,278 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:49,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,279 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 19:00:49,279 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 19:00:49,279 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:49,279 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-12 19:00:49,280 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-12 19:00:49,278 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:49,280 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 19:00:49,283 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-12 19:00:49,283 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 19:00:49,283 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-12 19:00:49,283 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-12 19:00:49,283 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-12 19:00:49,284 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,285 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,285 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,285 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,285 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:49,285 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,285 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:49,285 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,285 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:49,285 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,285 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:49,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,286 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:49,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-12 19:00:49,287 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61bdd6b[Count = 1] remaining members to acquire global barrier 2023-09-12 19:00:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:49,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-12 19:00:49,290 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61bdd6b[Count = 0] remaining members to acquire global barrier 2023-09-12 19:00:49,290 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-12 19:00:49,290 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,292 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,292 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,292 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,292 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,292 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 19:00:49,293 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 19:00:49,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,293 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:49,293 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:49,293 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 19:00:49,293 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,293 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:00:49,293 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:49,293 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:49,293 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. started... 2023-09-12 19:00:49,293 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:49,293 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-12 19:00:49,293 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. started... 2023-09-12 19:00:49,293 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:49,293 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:00:49,295 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2b8da1ed148e733ea84483703814ed37: 2023-09-12 19:00:49,295 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d5a429f251b328ccc3f9cfb9deb21f8: 2023-09-12 19:00:49,295 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,295 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,295 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:49,296 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:49,296 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:00:49,296 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:00:49,297 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 19:00:49,297 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:49,297 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-12 19:00:49,321 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. completed. 2023-09-12 19:00:49,321 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:49,321 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. completed. 2023-09-12 19:00:49,321 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:49,321 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:49,321 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:49,321 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:49,321 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:49,321 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,322 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,322 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-12 19:00:49,322 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-12 19:00:49,322 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:00:49,322 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:00:49,326 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,326 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 19:00:49,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:49,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:49,326 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 19:00:49,326 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:49,326 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-12 19:00:49,326 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:49,326 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,328 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-12 19:00:49,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:49,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:49,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:49,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,38579,1694545208565': 2023-09-12 19:00:49,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-12 19:00:49,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:49,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:49,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:49,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:49,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,42275,1694545208517': 2023-09-12 19:00:49,334 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-12 19:00:49,334 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-12 19:00:49,334 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:00:49,334 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:00:49,334 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,334 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:00:49,341 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,341 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,341 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,341 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,341 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,342 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,341 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,342 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:49,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:49,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,342 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,343 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,345 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:49,346 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,346 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,351 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,351 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,351 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,351 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,351 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,351 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,352 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,352 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:49,352 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,351 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,353 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,352 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,352 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-12 19:00:49,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,353 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,354 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,354 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:00:49,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,354 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,354 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,354 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,354 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,354 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 19:00:49,359 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:49,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-12 19:00:49,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:49,361 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:00:49,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,382 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,383 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-12 19:00:49,383 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,384 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-12 19:00:49,384 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694545249258Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694545249362 (+104 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1694545249362Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1694545249362Writing data manifest for emptySnaptb0-testConsecutiveExports at 1694545249366 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1694545249376 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694545249383 (+7 ms) 2023-09-12 19:00:49,389 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 19:00:49,391 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 130 msec 2023-09-12 19:00:49,561 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:49,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-12 19:00:49,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:00:49,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42275] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:00:49,570 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38579] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:00:49,574 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-12 19:00:49,574 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:49,575 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:00:49,586 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 19:00:49,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545249586 (current time:1694545249586). 2023-09-12 19:00:49,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:00:49,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x7ea6492c to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:49,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1994ceab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:49,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:49,603 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49742, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:49,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ea6492c to 127.0.0.1:53172 2023-09-12 19:00:49,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:49,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x0c475356 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:00:49,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40e494db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:00:49,615 DEBUG [hconnection-0x7f3aebfa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:49,616 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:49758, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:49,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:00:49,623 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:41494, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:00:49,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0c475356 to 127.0.0.1:53172 2023-09-12 19:00:49,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:00:49,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-12 19:00:49,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:00:49,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 19:00:49,628 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 19:00:49,629 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 19:00:49,630 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1694545849630 2023-09-12 19:00:49,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-12 19:00:49,630 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-12 19:00:49,631 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:00:49,631 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:00:49,632 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-12 19:00:49,633 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 19:00:49,633 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-09-12 19:00:49,635 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 19:00:49,635 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1694545849635 2023-09-12 19:00:49,646 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-12 19:00:49,646 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-12 19:00:49,646 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:49,647 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-12 19:00:49,647 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-12 19:00:49,648 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,648 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,649 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,649 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,649 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,649 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,649 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,649 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,649 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,650 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,650 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-12 19:00:49,650 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 19:00:49,650 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 19:00:49,650 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:49,650 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-12 19:00:49,652 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 19:00:49,652 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-12 19:00:49,650 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:49,652 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-12 19:00:49,652 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-12 19:00:49,652 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 19:00:49,653 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-12 19:00:49,653 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-12 19:00:49,653 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:00:49,653 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-12 19:00:49,654 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-12 19:00:49,654 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-12 19:00:49,654 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-12 19:00:49,659 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,659 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:49,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:49,660 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,660 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,660 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,660 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:49,660 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:49,660 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,660 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:49,660 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,661 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:00:49,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:49,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 19:00:49,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:49,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-12 19:00:49,662 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fb75d90[Count = 1] remaining members to acquire global barrier 2023-09-12 19:00:49,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:49,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 19:00:49,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:49,664 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-12 19:00:49,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fb75d90[Count = 0] remaining members to acquire global barrier 2023-09-12 19:00:49,665 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-12 19:00:49,665 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,665 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,665 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,665 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,665 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,666 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 19:00:49,666 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,666 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,666 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 19:00:49,666 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:49,666 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:49,666 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-12 19:00:49,666 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-12 19:00:49,666 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:49,666 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,666 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. started... 2023-09-12 19:00:49,666 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:00:49,666 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:00:49,667 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2d5a429f251b328ccc3f9cfb9deb21f8 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-12 19:00:49,667 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:00:49,668 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:00:49,668 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:49,668 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. started... 2023-09-12 19:00:49,668 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 19:00:49,668 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2b8da1ed148e733ea84483703814ed37 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-12 19:00:49,668 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:49,668 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-12 19:00:49,696 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023091247efed0c2e4840a586450f8ccb022d1f to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091247efed0c2e4840a586450f8ccb022d1f 2023-09-12 19:00:49,701 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091201aa64821b434878a4c33e951a8fe86c to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091201aa64821b434878a4c33e951a8fe86c 2023-09-12 19:00:49,709 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/.tmp/cf/aaba9e42279e4d1da2db9eda54a22187 2023-09-12 19:00:49,711 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/.tmp/cf/d2178f6dd0cc41ba85a83beced95ed84 2023-09-12 19:00:49,718 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/.tmp/cf/aaba9e42279e4d1da2db9eda54a22187 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/cf/aaba9e42279e4d1da2db9eda54a22187 2023-09-12 19:00:49,720 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/.tmp/cf/d2178f6dd0cc41ba85a83beced95ed84 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/cf/d2178f6dd0cc41ba85a83beced95ed84 2023-09-12 19:00:49,723 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/cf/aaba9e42279e4d1da2db9eda54a22187, entries=5, sequenceid=6, filesize=5.7 K 2023-09-12 19:00:49,724 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 2b8da1ed148e733ea84483703814ed37 in 56ms, sequenceid=6, compaction requested=false 2023-09-12 19:00:49,724 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-12 19:00:49,724 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2b8da1ed148e733ea84483703814ed37: 2023-09-12 19:00:49,725 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-12 19:00:49,725 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:49,725 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/cf/aaba9e42279e4d1da2db9eda54a22187] hfiles 2023-09-12 19:00:49,725 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/cf/aaba9e42279e4d1da2db9eda54a22187 for snapshot=snaptb0-testConsecutiveExports 2023-09-12 19:00:49,725 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/cf/d2178f6dd0cc41ba85a83beced95ed84, entries=45, sequenceid=6, filesize=12.4 K 2023-09-12 19:00:49,726 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for 2d5a429f251b328ccc3f9cfb9deb21f8 in 60ms, sequenceid=6, compaction requested=false 2023-09-12 19:00:49,728 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2d5a429f251b328ccc3f9cfb9deb21f8: 2023-09-12 19:00:49,728 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-12 19:00:49,728 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:00:49,728 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/cf/d2178f6dd0cc41ba85a83beced95ed84] hfiles 2023-09-12 19:00:49,728 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/cf/d2178f6dd0cc41ba85a83beced95ed84 for snapshot=snaptb0-testConsecutiveExports 2023-09-12 19:00:49,731 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:49,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-12 19:00:49,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:00:49,733 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:00:49,735 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. completed. 2023-09-12 19:00:49,735 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:00:49,735 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:49,735 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:49,735 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,735 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-12 19:00:49,735 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:00:49,736 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,736 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 19:00:49,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:49,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:49,736 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:49,736 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-12 19:00:49,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:49,738 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. completed. 2023-09-12 19:00:49,738 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:00:49,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:49,738 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:00:49,738 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:00:49,738 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,738 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-12 19:00:49,738 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:00:49,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 19:00:49,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,739 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,739 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-12 19:00:49,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,739 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:49,739 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-12 19:00:49,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 19:00:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,42275,1694545208517': 2023-09-12 19:00:49,742 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-12 19:00:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:49,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:49,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:49,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 19:00:49,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 19:00:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase20.apache.org,38579,1694545208565': 2023-09-12 19:00:49,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-12 19:00:49,745 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-12 19:00:49,745 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:00:49,745 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:00:49,745 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-12 19:00:49,745 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:00:49,751 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,751 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,751 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,751 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,751 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,751 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:00:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:00:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,752 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,751 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:00:49,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,757 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,757 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 19:00:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,757 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:00:49,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 19:00:49,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:00:49,760 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-12 19:00:49,761 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,761 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,765 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,765 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,765 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,765 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,765 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:00:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-12 19:00:49,765 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,765 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,765 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,765 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,766 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,765 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-12 19:00:49,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,765 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:00:49,765 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:00:49,765 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:00:49,766 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:00:49,766 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-12 19:00:49,766 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:00:49,768 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,768 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:00:49,768 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:00:49,768 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:00:49,768 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,768 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:00:49,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:00:49,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091201aa64821b434878a4c33e951a8fe86c, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091247efed0c2e4840a586450f8ccb022d1f] mob files 2023-09-12 19:00:49,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091201aa64821b434878a4c33e951a8fe86c 2023-09-12 19:00:49,769 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091247efed0c2e4840a586450f8ccb022d1f 2023-09-12 19:00:49,776 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-12 19:00:49,777 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,798 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-12 19:00:49,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,799 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,799 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1694545249630Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1694545249776 (+146 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1694545249776Loading Region manifests for snaptb0-testConsecutiveExports at 1694545249776Writing data manifest for snaptb0-testConsecutiveExports at 1694545249783 (+7 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1694545249791 (+8 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1694545249798 (+7 ms) 2023-09-12 19:00:49,801 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-12 19:00:49,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 171 msec 2023-09-12 19:00:49,933 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:00:49,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-12 19:00:49,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:00:49,937 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937 2023-09-12 19:00:49,938 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937, srcFsUri=hdfs://localhost:36845, srcDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:00:49,962 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:00:49,962 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2223a6fb, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,962 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0, snapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-12 19:00:49,971 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 19:00:49,984 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:49,985 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:49,985 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:49,985 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:50,688 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-7447923170194282528.jar 2023-09-12 19:00:50,689 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:50,689 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:50,742 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-1131807508755695337.jar 2023-09-12 19:00:50,742 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:50,743 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:50,743 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:50,743 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:50,744 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:50,744 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 19:00:50,744 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 19:00:50,745 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 19:00:50,745 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 19:00:50,745 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 19:00:50,746 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 19:00:50,746 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 19:00:50,746 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 19:00:50,747 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 19:00:50,747 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 19:00:50,747 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 19:00:50,748 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:50,748 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:50,748 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:00:50,749 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:50,749 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:00:50,749 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:00:50,750 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:00:51,118 WARN [Listener at jenkins-hbase20.apache.org/37289] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 19:00:51,120 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-12 19:00:51,144 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-12 19:00:52,518 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:00:52,518 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:00:52,521 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0002_000001 (auth:SIMPLE) 2023-09-12 19:00:53,337 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0003_000001 (auth:SIMPLE) 2023-09-12 19:00:53,848 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 19:00:56,712 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0003_000001 (auth:SIMPLE) 2023-09-12 19:00:58,914 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0003_000001 (auth:SIMPLE) 2023-09-12 19:01:00,986 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0003_000001 (auth:SIMPLE) 2023-09-12 19:01:02,339 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 19:01:02,340 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 19:01:02,343 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-12 19:01:02,343 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 19:01:02,344 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 19:01:02,344 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-12 19:01:02,346 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-12 19:01:02,346 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-12 19:01:02,346 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@43bcdd17 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-12 19:01:02,346 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-12 19:01:02,347 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-12 19:01:02,348 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937, srcFsUri=hdfs://localhost:36845, srcDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:01:02,365 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:01:02,365 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@7135f06c, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 19:01:02,365 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0, snapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-12 19:01:02,375 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-12 19:01:02,385 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:02,386 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:02,386 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:02,387 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:03,090 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-5390224302335192094.jar 2023-09-12 19:01:03,090 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:03,091 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:03,145 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-5618050636855745558.jar 2023-09-12 19:01:03,145 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:03,146 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:03,146 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:03,146 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:03,147 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:03,147 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:03,147 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 19:01:03,148 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 19:01:03,148 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 19:01:03,148 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 19:01:03,149 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 19:01:03,149 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 19:01:03,149 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 19:01:03,150 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 19:01:03,150 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 19:01:03,151 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 19:01:03,152 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:03,152 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:03,153 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:03,153 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:03,153 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:03,154 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:03,155 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:03,512 WARN [Listener at jenkins-hbase20.apache.org/37289] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 19:01:03,514 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-12 19:01:03,516 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-12 19:01:07,178 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:01:07,178 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:01:07,180 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0003_000001 (auth:SIMPLE) 2023-09-12 19:01:07,540 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0004_000001 (auth:SIMPLE) 2023-09-12 19:01:10,893 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0004_000001 (auth:SIMPLE) 2023-09-12 19:01:13,098 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0004_000001 (auth:SIMPLE) 2023-09-12 19:01:15,634 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0004_000001 (auth:SIMPLE) 2023-09-12 19:01:16,711 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 19:01:16,711 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 19:01:16,714 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-12 19:01:16,714 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 19:01:16,714 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 19:01:16,715 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-12 19:01:16,718 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-12 19:01:16,718 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-12 19:01:16,718 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@43bcdd17 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-12 19:01:16,719 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-12 19:01:16,719 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/local-export-1694545249937/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-12 19:01:16,731 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-12 19:01:16,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testConsecutiveExports 2023-09-12 19:01:16,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-12 19:01:16,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-12 19:01:16,735 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545276735"}]},"ts":"1694545276735"} 2023-09-12 19:01:16,737 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-12 19:01:16,752 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-12 19:01:16,753 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b8da1ed148e733ea84483703814ed37, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2d5a429f251b328ccc3f9cfb9deb21f8, UNASSIGN}] 2023-09-12 19:01:16,756 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2d5a429f251b328ccc3f9cfb9deb21f8, UNASSIGN 2023-09-12 19:01:16,756 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b8da1ed148e733ea84483703814ed37, UNASSIGN 2023-09-12 19:01:16,757 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=2d5a429f251b328ccc3f9cfb9deb21f8, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:16,757 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694545276756"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545276756"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545276756"}]},"ts":"1694545276756"} 2023-09-12 19:01:16,757 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=2b8da1ed148e733ea84483703814ed37, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:16,757 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694545276757"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545276757"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545276757"}]},"ts":"1694545276757"} 2023-09-12 19:01:16,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 2d5a429f251b328ccc3f9cfb9deb21f8, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:01:16,760 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 2b8da1ed148e733ea84483703814ed37, server=jenkins-hbase20.apache.org,42275,1694545208517}] 2023-09-12 19:01:16,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-12 19:01:16,913 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:01:16,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2d5a429f251b328ccc3f9cfb9deb21f8, disabling compactions & flushes 2023-09-12 19:01:16,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:01:16,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:01:16,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. after waiting 0 ms 2023-09-12 19:01:16,914 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 2b8da1ed148e733ea84483703814ed37 2023-09-12 19:01:16,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:01:16,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 2b8da1ed148e733ea84483703814ed37, disabling compactions & flushes 2023-09-12 19:01:16,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:01:16,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:01:16,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. after waiting 0 ms 2023-09-12 19:01:16,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:01:16,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:01:16,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:01:16,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:16,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:16,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8. 2023-09-12 19:01:16,940 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37. 2023-09-12 19:01:16,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2d5a429f251b328ccc3f9cfb9deb21f8: 2023-09-12 19:01:16,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 2b8da1ed148e733ea84483703814ed37: 2023-09-12 19:01:16,942 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:01:16,943 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=2d5a429f251b328ccc3f9cfb9deb21f8, regionState=CLOSED 2023-09-12 19:01:16,943 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694545276943"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545276943"}]},"ts":"1694545276943"} 2023-09-12 19:01:16,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 2b8da1ed148e733ea84483703814ed37 2023-09-12 19:01:16,944 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=2b8da1ed148e733ea84483703814ed37, regionState=CLOSED 2023-09-12 19:01:16,944 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1694545276944"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545276944"}]},"ts":"1694545276944"} 2023-09-12 19:01:16,946 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-12 19:01:16,947 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 2d5a429f251b328ccc3f9cfb9deb21f8, server=jenkins-hbase20.apache.org,38579,1694545208565 in 186 msec 2023-09-12 19:01:16,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-12 19:01:16,947 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 2b8da1ed148e733ea84483703814ed37, server=jenkins-hbase20.apache.org,42275,1694545208517 in 185 msec 2023-09-12 19:01:16,949 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2d5a429f251b328ccc3f9cfb9deb21f8, UNASSIGN in 194 msec 2023-09-12 19:01:16,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=52, resume processing ppid=51 2023-09-12 19:01:16,949 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=2b8da1ed148e733ea84483703814ed37, UNASSIGN in 194 msec 2023-09-12 19:01:16,950 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545276950"}]},"ts":"1694545276950"} 2023-09-12 19:01:16,951 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-12 19:01:16,952 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-12 19:01:16,954 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 222 msec 2023-09-12 19:01:17,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-12 19:01:17,040 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-12 19:01:17,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testConsecutiveExports 2023-09-12 19:01:17,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 19:01:17,047 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 19:01:17,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-12 19:01:17,049 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 19:01:17,054 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-12 19:01:17,058 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 19:01:17,058 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 19:01:17,058 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 19:01:17,058 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 19:01:17,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-12 19:01:17,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-12 19:01:17,058 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-12 19:01:17,059 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-12 19:01:17,059 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 19:01:17,059 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 19:01:17,059 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:17,059 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 19:01:17,059 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:17,059 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-12 19:01:17,060 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:17,059 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:17,060 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37 2023-09-12 19:01:17,060 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:01:17,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-12 19:01:17,062 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/recovered.edits] 2023-09-12 19:01:17,062 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/recovered.edits] 2023-09-12 19:01:17,067 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/cf/aaba9e42279e4d1da2db9eda54a22187 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/cf/aaba9e42279e4d1da2db9eda54a22187 2023-09-12 19:01:17,067 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/cf/d2178f6dd0cc41ba85a83beced95ed84 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/cf/d2178f6dd0cc41ba85a83beced95ed84 2023-09-12 19:01:17,070 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37/recovered.edits/9.seqid 2023-09-12 19:01:17,070 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8/recovered.edits/9.seqid 2023-09-12 19:01:17,070 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2b8da1ed148e733ea84483703814ed37 2023-09-12 19:01:17,071 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testConsecutiveExports/2d5a429f251b328ccc3f9cfb9deb21f8 2023-09-12 19:01:17,071 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-12 19:01:17,071 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-12 19:01:17,072 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-12 19:01:17,075 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091201aa64821b434878a4c33e951a8fe86c to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023091201aa64821b434878a4c33e951a8fe86c 2023-09-12 19:01:17,077 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091247efed0c2e4840a586450f8ccb022d1f to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e2023091247efed0c2e4840a586450f8ccb022d1f 2023-09-12 19:01:17,077 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-12 19:01:17,079 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 19:01:17,082 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-12 19:01:17,084 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-12 19:01:17,085 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 19:01:17,085 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-12 19:01:17,085 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545277085"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:17,085 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545277085"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:17,087 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 19:01:17,087 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2b8da1ed148e733ea84483703814ed37, NAME => 'testtb-testConsecutiveExports,,1694545248573.2b8da1ed148e733ea84483703814ed37.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2d5a429f251b328ccc3f9cfb9deb21f8, NAME => 'testtb-testConsecutiveExports,1,1694545248573.2d5a429f251b328ccc3f9cfb9deb21f8.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 19:01:17,087 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-12 19:01:17,087 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694545277087"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:17,092 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-12 19:01:17,093 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-12 19:01:17,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 51 msec 2023-09-12 19:01:17,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-12 19:01:17,162 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-12 19:01:17,173 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-12 19:01:17,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-12 19:01:17,183 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testConsecutiveExports" 2023-09-12 19:01:17,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-12 19:01:17,209 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=758 (was 767), OpenFileDescriptor=923 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=153 (was 199), ProcessCount=167 (was 167), AvailableMemoryMB=1946 (was 2153) 2023-09-12 19:01:17,209 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-12 19:01:17,232 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758, OpenFileDescriptor=923, MaxFileDescriptor=60000, SystemLoadAverage=153, ProcessCount=167, AvailableMemoryMB=1945 2023-09-12 19:01:17,232 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-12 19:01:17,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 19:01:17,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,238 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 19:01:17,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-12 19:01:17,239 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 19:01:17,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-12 19:01:17,242 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:17,242 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:17,243 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53 empty. 2023-09-12 19:01:17,243 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148 empty. 2023-09-12 19:01:17,243 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:17,243 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:17,243 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-12 19:01:17,256 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-12 19:01:17,258 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => d5d1930963ee18eed4e6d1d7fb97cd53, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:01:17,259 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6fab29979398f7f84e1d95919f99b148, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:01:17,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:17,272 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing d5d1930963ee18eed4e6d1d7fb97cd53, disabling compactions & flushes 2023-09-12 19:01:17,273 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:17,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:17,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. after waiting 0 ms 2023-09-12 19:01:17,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:17,273 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:17,273 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for d5d1930963ee18eed4e6d1d7fb97cd53: 2023-09-12 19:01:17,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:17,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 6fab29979398f7f84e1d95919f99b148, disabling compactions & flushes 2023-09-12 19:01:17,275 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:17,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:17,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. after waiting 0 ms 2023-09-12 19:01:17,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:17,275 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:17,275 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 6fab29979398f7f84e1d95919f99b148: 2023-09-12 19:01:17,278 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 19:01:17,278 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694545277278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545277278"}]},"ts":"1694545277278"} 2023-09-12 19:01:17,279 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694545277278"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545277278"}]},"ts":"1694545277278"} 2023-09-12 19:01:17,284 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 19:01:17,285 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 19:01:17,285 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545277285"}]},"ts":"1694545277285"} 2023-09-12 19:01:17,286 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-12 19:01:17,288 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-12 19:01:17,289 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 19:01:17,289 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 19:01:17,290 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 19:01:17,290 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 19:01:17,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d5d1930963ee18eed4e6d1d7fb97cd53, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6fab29979398f7f84e1d95919f99b148, ASSIGN}] 2023-09-12 19:01:17,292 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6fab29979398f7f84e1d95919f99b148, ASSIGN 2023-09-12 19:01:17,292 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d5d1930963ee18eed4e6d1d7fb97cd53, ASSIGN 2023-09-12 19:01:17,293 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6fab29979398f7f84e1d95919f99b148, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42275,1694545208517; forceNewPlan=false, retain=false 2023-09-12 19:01:17,293 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d5d1930963ee18eed4e6d1d7fb97cd53, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38579,1694545208565; forceNewPlan=false, retain=false 2023-09-12 19:01:17,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-12 19:01:17,443 INFO [jenkins-hbase20:38069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 19:01:17,449 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6fab29979398f7f84e1d95919f99b148, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,449 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d5d1930963ee18eed4e6d1d7fb97cd53, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,449 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694545277449"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545277449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545277449"}]},"ts":"1694545277449"} 2023-09-12 19:01:17,449 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694545277449"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545277449"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545277449"}]},"ts":"1694545277449"} 2023-09-12 19:01:17,453 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure 6fab29979398f7f84e1d95919f99b148, server=jenkins-hbase20.apache.org,42275,1694545208517}] 2023-09-12 19:01:17,454 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure d5d1930963ee18eed4e6d1d7fb97cd53, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:01:17,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-12 19:01:17,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:17,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6fab29979398f7f84e1d95919f99b148, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 19:01:17,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:17,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. service=AccessControlService 2023-09-12 19:01:17,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d5d1930963ee18eed4e6d1d7fb97cd53, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 19:01:17,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:01:17,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. service=AccessControlService 2023-09-12 19:01:17,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:17,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:01:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:17,616 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:17,618 INFO [StoreOpener-6fab29979398f7f84e1d95919f99b148-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:17,618 INFO [StoreOpener-d5d1930963ee18eed4e6d1d7fb97cd53-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:17,622 DEBUG [StoreOpener-6fab29979398f7f84e1d95919f99b148-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/cf 2023-09-12 19:01:17,622 DEBUG [StoreOpener-6fab29979398f7f84e1d95919f99b148-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/cf 2023-09-12 19:01:17,622 DEBUG [StoreOpener-d5d1930963ee18eed4e6d1d7fb97cd53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/cf 2023-09-12 19:01:17,622 DEBUG [StoreOpener-d5d1930963ee18eed4e6d1d7fb97cd53-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/cf 2023-09-12 19:01:17,623 INFO [StoreOpener-6fab29979398f7f84e1d95919f99b148-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6fab29979398f7f84e1d95919f99b148 columnFamilyName cf 2023-09-12 19:01:17,623 INFO [StoreOpener-d5d1930963ee18eed4e6d1d7fb97cd53-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d5d1930963ee18eed4e6d1d7fb97cd53 columnFamilyName cf 2023-09-12 19:01:17,625 INFO [StoreOpener-6fab29979398f7f84e1d95919f99b148-1] regionserver.HStore(310): Store=6fab29979398f7f84e1d95919f99b148/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:01:17,625 INFO [StoreOpener-d5d1930963ee18eed4e6d1d7fb97cd53-1] regionserver.HStore(310): Store=d5d1930963ee18eed4e6d1d7fb97cd53/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:01:17,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:17,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:17,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:17,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:17,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:17,631 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:17,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:01:17,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:01:17,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6fab29979398f7f84e1d95919f99b148; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73756197, jitterRate=0.09905298054218292}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:01:17,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6fab29979398f7f84e1d95919f99b148: 2023-09-12 19:01:17,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened d5d1930963ee18eed4e6d1d7fb97cd53; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65157749, jitterRate=-0.02907387912273407}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:01:17,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for d5d1930963ee18eed4e6d1d7fb97cd53: 2023-09-12 19:01:17,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148., pid=60, masterSystemTime=1694545277606 2023-09-12 19:01:17,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53., pid=61, masterSystemTime=1694545277607 2023-09-12 19:01:17,635 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:17,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:17,636 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=d5d1930963ee18eed4e6d1d7fb97cd53, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,636 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694545277636"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545277636"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545277636"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545277636"}]},"ts":"1694545277636"} 2023-09-12 19:01:17,636 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:17,636 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:17,637 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=6fab29979398f7f84e1d95919f99b148, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,637 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694545277637"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545277637"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545277637"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545277637"}]},"ts":"1694545277637"} 2023-09-12 19:01:17,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-12 19:01:17,640 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure d5d1930963ee18eed4e6d1d7fb97cd53, server=jenkins-hbase20.apache.org,38579,1694545208565 in 184 msec 2023-09-12 19:01:17,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-12 19:01:17,641 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure 6fab29979398f7f84e1d95919f99b148, server=jenkins-hbase20.apache.org,42275,1694545208517 in 187 msec 2023-09-12 19:01:17,641 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d5d1930963ee18eed4e6d1d7fb97cd53, ASSIGN in 350 msec 2023-09-12 19:01:17,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-12 19:01:17,642 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6fab29979398f7f84e1d95919f99b148, ASSIGN in 351 msec 2023-09-12 19:01:17,643 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 19:01:17,643 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545277643"}]},"ts":"1694545277643"} 2023-09-12 19:01:17,644 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-12 19:01:17,646 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 19:01:17,646 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-12 19:01:17,648 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-12 19:01:17,649 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:17,649 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:17,649 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:17,649 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:17,650 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:17,650 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:17,650 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:17,650 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:17,651 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 416 msec 2023-09-12 19:01:17,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-12 19:01:17,847 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-12 19:01:17,853 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,853 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:17,859 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:01:17,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 19:01:17,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545277876 (current time:1694545277876). 2023-09-12 19:01:17,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:01:17,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x689e93d8 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:17,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7beaf95e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:17,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:17,885 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:17,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x689e93d8 to 127.0.0.1:53172 2023-09-12 19:01:17,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:17,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x7e8aaf59 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:17,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6296f303, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:17,895 DEBUG [hconnection-0x4e1ad606-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:17,898 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:17,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:17,905 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:17,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e8aaf59 to 127.0.0.1:53172 2023-09-12 19:01:17,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:17,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-12 19:01:17,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:01:17,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 19:01:17,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 19:01:17,910 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 19:01:17,911 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694545877911 2023-09-12 19:01:17,911 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 19:01:17,913 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:01:17,913 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:01:17,914 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 19:01:17,915 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 19:01:17,916 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-12 19:01:17,917 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 19:01:17,918 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694545877918 2023-09-12 19:01:17,927 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,927 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-12 19:01:17,927 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:17,928 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-12 19:01:17,928 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-12 19:01:17,928 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,929 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,929 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:17,929 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:17,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:17,929 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:17,929 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:17,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:17,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:17,930 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:17,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:17,930 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,930 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,930 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:01:17,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,931 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 19:01:17,931 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:17,931 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 19:01:17,931 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:17,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,932 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 19:01:17,933 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 19:01:17,933 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:17,933 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 19:01:17,934 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 19:01:17,934 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 19:01:17,933 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 19:01:17,934 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 19:01:17,934 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 19:01:17,934 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 19:01:17,934 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 19:01:17,940 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,940 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,940 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:17,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:17,940 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,940 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,941 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:17,940 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,941 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:17,940 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,941 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,941 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,941 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:17,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-12 19:01:17,942 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ce24ff4[Count = 1] remaining members to acquire global barrier 2023-09-12 19:01:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:17,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:17,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-12 19:01:17,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3ce24ff4[Count = 0] remaining members to acquire global barrier 2023-09-12 19:01:17,944 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-12 19:01:17,944 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,945 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,945 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,945 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,945 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,945 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 19:01:17,945 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 19:01:17,945 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,945 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:17,945 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:17,945 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 19:01:17,946 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 19:01:17,945 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:17,945 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,946 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:01:17,946 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:01:17,945 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. started... 2023-09-12 19:01:17,948 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 19:01:17,948 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:17,948 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 19:01:17,950 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:17,952 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:17,952 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:17,952 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6fab29979398f7f84e1d95919f99b148: 2023-09-12 19:01:17,952 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. started... 2023-09-12 19:01:17,952 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5d1930963ee18eed4e6d1d7fb97cd53: 2023-09-12 19:01:17,952 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,952 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:17,952 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,952 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:01:17,952 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:17,952 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:01:17,966 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. completed. 2023-09-12 19:01:17,966 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:17,967 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:17,967 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:17,967 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,967 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 19:01:17,967 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:01:17,968 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 19:01:17,968 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,968 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:17,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:17,968 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 19:01:17,970 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. completed. 2023-09-12 19:01:17,970 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:17,970 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:17,970 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:17,970 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,970 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 19:01:17,970 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:01:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:17,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,971 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,971 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 19:01:17,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,971 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:17,971 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 19:01:17,972 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38579,1694545208565': 2023-09-12 19:01:17,974 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-12 19:01:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:17,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,42275,1694545208517': 2023-09-12 19:01:17,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-12 19:01:17,977 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-12 19:01:17,977 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:01:17,977 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:01:17,977 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,977 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:01:17,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:17,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:17,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:17,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:17,979 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:17,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,979 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,980 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,981 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:17,981 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,983 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,983 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,983 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:17,983 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:17,983 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,983 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:17,983 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:17,983 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:17,983 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:17,983 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:17,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:17,983 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,983 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:17,983 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:17,985 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:17,983 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:17,985 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:17,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:17,985 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:01:17,985 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:17,985 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:17,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:17,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:17,986 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:17,986 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:17,986 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,986 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,986 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 19:01:17,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:17,998 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,013 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:18,014 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-12 19:01:18,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,014 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,014 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694545277912Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694545277998 (+86 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694545277998Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694545277998Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694545278001 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1694545278007 (+6 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694545278014 (+7 ms) 2023-09-12 19:01:18,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-12 19:01:18,016 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 19:01:18,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:01:18,018 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 103 msec 2023-09-12 19:01:18,019 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38579] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:01:18,021 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42275] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:01:18,024 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,024 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:18,024 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:01:18,035 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 19:01:18,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545278036 (current time:1694545278036). 2023-09-12 19:01:18,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:01:18,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x213ff94a to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:18,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@8322c2e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:18,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:18,048 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:18,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x213ff94a to 127.0.0.1:53172 2023-09-12 19:01:18,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:18,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x0220d76f to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:18,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5c0b9bc8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:18,062 DEBUG [hconnection-0x45419f3b-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:18,066 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59944, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:18,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:18,076 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:18,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0220d76f to 127.0.0.1:53172 2023-09-12 19:01:18,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:18,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-12 19:01:18,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:01:18,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 19:01:18,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 19:01:18,083 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 19:01:18,084 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1694545878084 2023-09-12 19:01:18,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-12 19:01:18,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,086 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:01:18,086 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:01:18,088 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-12 19:01:18,088 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 19:01:18,090 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-09-12 19:01:18,092 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 19:01:18,093 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1694545878093 2023-09-12 19:01:18,101 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,101 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-12 19:01:18,101 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:18,102 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-12 19:01:18,102 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-12 19:01:18,103 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,103 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,104 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:18,104 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,104 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:18,104 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:18,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:18,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:18,104 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:18,104 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,104 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,104 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,104 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:01:18,104 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 19:01:18,105 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 19:01:18,106 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 19:01:18,107 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 19:01:18,106 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:18,105 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-12 19:01:18,107 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:18,107 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 19:01:18,108 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 19:01:18,108 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 19:01:18,107 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 19:01:18,108 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-12 19:01:18,108 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-12 19:01:18,108 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-12 19:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,109 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,109 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:18,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,109 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:18,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-12 19:01:18,111 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43ce31[Count = 1] remaining members to acquire global barrier 2023-09-12 19:01:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:18,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:18,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-12 19:01:18,113 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43ce31[Count = 0] remaining members to acquire global barrier 2023-09-12 19:01:18,113 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-12 19:01:18,113 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,114 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,114 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,114 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,114 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,114 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 19:01:18,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,114 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,114 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 19:01:18,114 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 19:01:18,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,114 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,114 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-12 19:01:18,114 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:01:18,114 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:18,115 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:18,115 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. started... 2023-09-12 19:01:18,114 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:01:18,114 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:18,115 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:18,115 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:18,115 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:18,115 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. started... 2023-09-12 19:01:18,115 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2745): Flushing d5d1930963ee18eed4e6d1d7fb97cd53 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-12 19:01:18,115 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6fab29979398f7f84e1d95919f99b148 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-12 19:01:18,116 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 19:01:18,116 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:18,116 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 19:01:18,143 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230912f2509fb8062449ab8b52600eca6fbf45 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230912f2509fb8062449ab8b52600eca6fbf45 2023-09-12 19:01:18,143 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309121d054572d6ff47f5a62d39f1b4441ac4 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309121d054572d6ff47f5a62d39f1b4441ac4 2023-09-12 19:01:18,157 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/.tmp/cf/b2e3d2f65f0c4637b1c353db50b58a73 2023-09-12 19:01:18,157 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/.tmp/cf/c8803b764b3a495fa5abf4f0fec81042 2023-09-12 19:01:18,162 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/.tmp/cf/c8803b764b3a495fa5abf4f0fec81042 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/cf/c8803b764b3a495fa5abf4f0fec81042 2023-09-12 19:01:18,162 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/.tmp/cf/b2e3d2f65f0c4637b1c353db50b58a73 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/cf/b2e3d2f65f0c4637b1c353db50b58a73 2023-09-12 19:01:18,167 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/cf/b2e3d2f65f0c4637b1c353db50b58a73, entries=48, sequenceid=6, filesize=13.7 K 2023-09-12 19:01:18,167 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/cf/c8803b764b3a495fa5abf4f0fec81042, entries=2, sequenceid=6, filesize=5.3 K 2023-09-12 19:01:18,168 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for d5d1930963ee18eed4e6d1d7fb97cd53 in 53ms, sequenceid=6, compaction requested=false 2023-09-12 19:01:18,168 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 6fab29979398f7f84e1d95919f99b148 in 53ms, sequenceid=6, compaction requested=false 2023-09-12 19:01:18,168 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-12 19:01:18,168 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-12 19:01:18,172 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for d5d1930963ee18eed4e6d1d7fb97cd53: 2023-09-12 19:01:18,172 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6fab29979398f7f84e1d95919f99b148: 2023-09-12 19:01:18,172 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,172 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,172 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:18,172 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:18,172 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/cf/c8803b764b3a495fa5abf4f0fec81042] hfiles 2023-09-12 19:01:18,172 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/cf/b2e3d2f65f0c4637b1c353db50b58a73] hfiles 2023-09-12 19:01:18,172 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/cf/c8803b764b3a495fa5abf4f0fec81042 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,172 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/cf/b2e3d2f65f0c4637b1c353db50b58a73 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,187 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:18,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-12 19:01:18,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:01:18,190 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:01:18,191 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. completed. 2023-09-12 19:01:18,191 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:18,191 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. completed. 2023-09-12 19:01:18,191 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:18,191 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:18,191 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:18,191 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:18,191 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:18,191 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,191 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,191 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 19:01:18,191 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-12 19:01:18,191 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:01:18,191 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:01:18,193 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,193 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 19:01:18,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:18,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:18,193 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:18,193 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,193 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-12 19:01:18,194 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 19:01:18,195 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:18,195 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-12 19:01:18,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:18,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:18,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,42275,1694545208517': 2023-09-12 19:01:18,199 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-12 19:01:18,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:18,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:18,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:18,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:18,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:18,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase20.apache.org,38579,1694545208565': 2023-09-12 19:01:18,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-12 19:01:18,202 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-12 19:01:18,202 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:01:18,202 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:01:18,202 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,202 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:01:18,209 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,209 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:18,209 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,209 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,209 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:18,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:18,210 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,209 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:18,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,209 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:18,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:18,210 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,211 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,211 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,212 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:18,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,214 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,214 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,215 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,215 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,218 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,218 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,218 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:18,218 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:18,218 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:18,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:18,218 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,218 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:18,218 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,218 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:18,218 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:18,219 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:18,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:18,218 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,218 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:18,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,218 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:18,218 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:18,219 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:01:18,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:18,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:18,219 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:18,219 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:18,221 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,221 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,221 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:18,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:18,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:18,221 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:18,222 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309121d054572d6ff47f5a62d39f1b4441ac4, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230912f2509fb8062449ab8b52600eca6fbf45] mob files 2023-09-12 19:01:18,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309121d054572d6ff47f5a62d39f1b4441ac4 2023-09-12 19:01:18,222 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230912f2509fb8062449ab8b52600eca6fbf45 2023-09-12 19:01:18,231 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,232 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,251 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-12 19:01:18,251 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,252 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:18,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1694545278085Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1694545278231 (+146 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694545278231Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1694545278231Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1694545278237 (+6 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1694545278245 (+8 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1694545278251 (+6 ms) 2023-09-12 19:01:18,254 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-12 19:01:18,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 168 msec 2023-09-12 19:01:18,390 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:18,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-12 19:01:18,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:01:18,424 DEBUG [Listener at jenkins-hbase20.apache.org/37289] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 19:01:18,427 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59954, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 19:01:18,428 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36759] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-12 19:01:18,428 DEBUG [Listener at jenkins-hbase20.apache.org/37289] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 19:01:18,433 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 19:01:18,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38579] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-12 19:01:18,434 DEBUG [Listener at jenkins-hbase20.apache.org/37289] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-12 19:01:18,435 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:60942, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-12 19:01:18,435 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42275] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-12 19:01:18,437 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-12 19:01:18,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:18,440 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 19:01:18,440 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-12 19:01:18,441 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 19:01:18,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-12 19:01:18,443 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:18,443 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:18,444 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6 empty. 2023-09-12 19:01:18,444 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be empty. 2023-09-12 19:01:18,444 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:18,444 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:18,444 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-12 19:01:18,453 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-12 19:01:18,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => bac638e560ad11510d3fe8810f826eb6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:01:18,454 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 61858d79cc4cfde2a783e5cf59dbc6be, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:01:18,464 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:18,464 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:18,464 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 61858d79cc4cfde2a783e5cf59dbc6be, disabling compactions & flushes 2023-09-12 19:01:18,464 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing bac638e560ad11510d3fe8810f826eb6, disabling compactions & flushes 2023-09-12 19:01:18,464 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:18,465 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:18,465 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:18,465 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:18,465 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. after waiting 0 ms 2023-09-12 19:01:18,465 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. after waiting 0 ms 2023-09-12 19:01:18,465 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:18,465 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:18,465 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:18,465 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:18,465 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 61858d79cc4cfde2a783e5cf59dbc6be: 2023-09-12 19:01:18,465 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for bac638e560ad11510d3fe8810f826eb6: 2023-09-12 19:01:18,467 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 19:01:18,468 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694545278468"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545278468"}]},"ts":"1694545278468"} 2023-09-12 19:01:18,468 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694545278468"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545278468"}]},"ts":"1694545278468"} 2023-09-12 19:01:18,470 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 19:01:18,470 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 19:01:18,471 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545278470"}]},"ts":"1694545278470"} 2023-09-12 19:01:18,472 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-12 19:01:18,474 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-12 19:01:18,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 19:01:18,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 19:01:18,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 19:01:18,475 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 19:01:18,475 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bac638e560ad11510d3fe8810f826eb6, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61858d79cc4cfde2a783e5cf59dbc6be, ASSIGN}] 2023-09-12 19:01:18,478 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bac638e560ad11510d3fe8810f826eb6, ASSIGN 2023-09-12 19:01:18,478 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61858d79cc4cfde2a783e5cf59dbc6be, ASSIGN 2023-09-12 19:01:18,479 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bac638e560ad11510d3fe8810f826eb6, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38579,1694545208565; forceNewPlan=false, retain=false 2023-09-12 19:01:18,479 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61858d79cc4cfde2a783e5cf59dbc6be, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36759,1694545208602; forceNewPlan=false, retain=false 2023-09-12 19:01:18,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-12 19:01:18,629 INFO [jenkins-hbase20:38069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 19:01:18,637 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bac638e560ad11510d3fe8810f826eb6, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,637 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=61858d79cc4cfde2a783e5cf59dbc6be, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,637 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694545278637"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545278637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545278637"}]},"ts":"1694545278637"} 2023-09-12 19:01:18,637 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694545278637"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545278637"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545278637"}]},"ts":"1694545278637"} 2023-09-12 19:01:18,639 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure bac638e560ad11510d3fe8810f826eb6, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:01:18,640 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 61858d79cc4cfde2a783e5cf59dbc6be, server=jenkins-hbase20.apache.org,36759,1694545208602}] 2023-09-12 19:01:18,746 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-12 19:01:18,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:18,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:18,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bac638e560ad11510d3fe8810f826eb6, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6.', STARTKEY => '', ENDKEY => '2'} 2023-09-12 19:01:18,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 61858d79cc4cfde2a783e5cf59dbc6be, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be.', STARTKEY => '2', ENDKEY => ''} 2023-09-12 19:01:18,803 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. service=AccessControlService 2023-09-12 19:01:18,803 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:01:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. service=AccessControlService 2023-09-12 19:01:18,804 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:01:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:18,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:18,805 INFO [StoreOpener-bac638e560ad11510d3fe8810f826eb6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:18,805 INFO [StoreOpener-61858d79cc4cfde2a783e5cf59dbc6be-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:18,807 DEBUG [StoreOpener-bac638e560ad11510d3fe8810f826eb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/cf 2023-09-12 19:01:18,807 DEBUG [StoreOpener-61858d79cc4cfde2a783e5cf59dbc6be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/cf 2023-09-12 19:01:18,807 DEBUG [StoreOpener-bac638e560ad11510d3fe8810f826eb6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/cf 2023-09-12 19:01:18,807 DEBUG [StoreOpener-61858d79cc4cfde2a783e5cf59dbc6be-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/cf 2023-09-12 19:01:18,807 INFO [StoreOpener-61858d79cc4cfde2a783e5cf59dbc6be-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 61858d79cc4cfde2a783e5cf59dbc6be columnFamilyName cf 2023-09-12 19:01:18,807 INFO [StoreOpener-bac638e560ad11510d3fe8810f826eb6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bac638e560ad11510d3fe8810f826eb6 columnFamilyName cf 2023-09-12 19:01:18,808 INFO [StoreOpener-61858d79cc4cfde2a783e5cf59dbc6be-1] regionserver.HStore(310): Store=61858d79cc4cfde2a783e5cf59dbc6be/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:01:18,808 INFO [StoreOpener-bac638e560ad11510d3fe8810f826eb6-1] regionserver.HStore(310): Store=bac638e560ad11510d3fe8810f826eb6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:01:18,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:18,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:18,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:18,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:18,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:18,812 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:18,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:01:18,814 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:01:18,814 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 61858d79cc4cfde2a783e5cf59dbc6be; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67364493, jitterRate=0.0038091689348220825}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:01:18,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 61858d79cc4cfde2a783e5cf59dbc6be: 2023-09-12 19:01:18,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened bac638e560ad11510d3fe8810f826eb6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68765171, jitterRate=0.02468089759349823}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:01:18,815 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for bac638e560ad11510d3fe8810f826eb6: 2023-09-12 19:01:18,815 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6., pid=69, masterSystemTime=1694545278790 2023-09-12 19:01:18,816 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be., pid=70, masterSystemTime=1694545278791 2023-09-12 19:01:18,817 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:18,817 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:18,818 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=61858d79cc4cfde2a783e5cf59dbc6be, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:18,818 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694545278817"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545278817"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545278817"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545278817"}]},"ts":"1694545278817"} 2023-09-12 19:01:18,818 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:18,818 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:18,818 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bac638e560ad11510d3fe8810f826eb6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:18,819 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694545278818"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545278818"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545278818"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545278818"}]},"ts":"1694545278818"} 2023-09-12 19:01:18,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-12 19:01:18,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 61858d79cc4cfde2a783e5cf59dbc6be, server=jenkins-hbase20.apache.org,36759,1694545208602 in 179 msec 2023-09-12 19:01:18,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-12 19:01:18,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure bac638e560ad11510d3fe8810f826eb6, server=jenkins-hbase20.apache.org,38579,1694545208565 in 181 msec 2023-09-12 19:01:18,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61858d79cc4cfde2a783e5cf59dbc6be, ASSIGN in 346 msec 2023-09-12 19:01:18,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=67, resume processing ppid=66 2023-09-12 19:01:18,823 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bac638e560ad11510d3fe8810f826eb6, ASSIGN in 347 msec 2023-09-12 19:01:18,824 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 19:01:18,824 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545278824"}]},"ts":"1694545278824"} 2023-09-12 19:01:18,825 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-12 19:01:18,826 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 19:01:18,827 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-12 19:01:18,828 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-12 19:01:18,829 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:18,829 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:18,829 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:18,829 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:18,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 393 msec 2023-09-12 19:01:19,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-12 19:01:19,050 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-12 19:01:19,080 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$2(1952): Client=jenkins//148.251.75.209 merge regions bac638e560ad11510d3fe8810f826eb6, 61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:19,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bac638e560ad11510d3fe8810f826eb6, 61858d79cc4cfde2a783e5cf59dbc6be], force=true 2023-09-12 19:01:19,089 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bac638e560ad11510d3fe8810f826eb6, 61858d79cc4cfde2a783e5cf59dbc6be], force=true 2023-09-12 19:01:19,089 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bac638e560ad11510d3fe8810f826eb6, 61858d79cc4cfde2a783e5cf59dbc6be], force=true 2023-09-12 19:01:19,089 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bac638e560ad11510d3fe8810f826eb6, 61858d79cc4cfde2a783e5cf59dbc6be], force=true 2023-09-12 19:01:19,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-12 19:01:19,110 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bac638e560ad11510d3fe8810f826eb6, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61858d79cc4cfde2a783e5cf59dbc6be, UNASSIGN}] 2023-09-12 19:01:19,112 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61858d79cc4cfde2a783e5cf59dbc6be, UNASSIGN 2023-09-12 19:01:19,113 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bac638e560ad11510d3fe8810f826eb6, UNASSIGN 2023-09-12 19:01:19,113 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=61858d79cc4cfde2a783e5cf59dbc6be, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:19,113 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bac638e560ad11510d3fe8810f826eb6, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:19,113 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694545279113"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545279113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545279113"}]},"ts":"1694545279113"} 2023-09-12 19:01:19,114 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694545279113"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545279113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545279113"}]},"ts":"1694545279113"} 2023-09-12 19:01:19,115 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure bac638e560ad11510d3fe8810f826eb6, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:01:19,116 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 61858d79cc4cfde2a783e5cf59dbc6be, server=jenkins-hbase20.apache.org,36759,1694545208602}] 2023-09-12 19:01:19,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-12 19:01:19,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:19,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:19,271 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing bac638e560ad11510d3fe8810f826eb6, disabling compactions & flushes 2023-09-12 19:01:19,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 61858d79cc4cfde2a783e5cf59dbc6be, disabling compactions & flushes 2023-09-12 19:01:19,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:19,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:19,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. after waiting 0 ms 2023-09-12 19:01:19,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:19,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:19,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 61858d79cc4cfde2a783e5cf59dbc6be 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-12 19:01:19,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:19,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. after waiting 0 ms 2023-09-12 19:01:19,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:19,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing bac638e560ad11510d3fe8810f826eb6 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-12 19:01:19,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/.tmp/cf/797d9a258afa4c43aecf9677a5756b0e 2023-09-12 19:01:19,296 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/.tmp/cf/9237453a5486400ba1f0235cf86e1958 2023-09-12 19:01:19,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/.tmp/cf/797d9a258afa4c43aecf9677a5756b0e as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/cf/797d9a258afa4c43aecf9677a5756b0e 2023-09-12 19:01:19,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/.tmp/cf/9237453a5486400ba1f0235cf86e1958 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/cf/9237453a5486400ba1f0235cf86e1958 2023-09-12 19:01:19,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/cf/797d9a258afa4c43aecf9677a5756b0e, entries=1, sequenceid=5, filesize=4.7 K 2023-09-12 19:01:19,309 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/cf/9237453a5486400ba1f0235cf86e1958, entries=1, sequenceid=5, filesize=4.7 K 2023-09-12 19:01:19,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 61858d79cc4cfde2a783e5cf59dbc6be in 37ms, sequenceid=5, compaction requested=false 2023-09-12 19:01:19,310 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-12 19:01:19,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for bac638e560ad11510d3fe8810f826eb6 in 40ms, sequenceid=5, compaction requested=false 2023-09-12 19:01:19,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-12 19:01:19,321 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-12 19:01:19,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:19,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:19,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6. 2023-09-12 19:01:19,322 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be. 2023-09-12 19:01:19,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for bac638e560ad11510d3fe8810f826eb6: 2023-09-12 19:01:19,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 61858d79cc4cfde2a783e5cf59dbc6be: 2023-09-12 19:01:19,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:19,324 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=61858d79cc4cfde2a783e5cf59dbc6be, regionState=CLOSED 2023-09-12 19:01:19,324 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:19,324 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694545279324"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545279324"}]},"ts":"1694545279324"} 2023-09-12 19:01:19,324 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bac638e560ad11510d3fe8810f826eb6, regionState=CLOSED 2023-09-12 19:01:19,324 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1694545279324"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545279324"}]},"ts":"1694545279324"} 2023-09-12 19:01:19,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-12 19:01:19,327 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 61858d79cc4cfde2a783e5cf59dbc6be, server=jenkins-hbase20.apache.org,36759,1694545208602 in 209 msec 2023-09-12 19:01:19,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-12 19:01:19,328 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure bac638e560ad11510d3fe8810f826eb6, server=jenkins-hbase20.apache.org,38579,1694545208565 in 211 msec 2023-09-12 19:01:19,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=61858d79cc4cfde2a783e5cf59dbc6be, UNASSIGN in 217 msec 2023-09-12 19:01:19,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-12 19:01:19,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bac638e560ad11510d3fe8810f826eb6, UNASSIGN in 221 msec 2023-09-12 19:01:19,373 DEBUG [PEWorker-4] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-12 19:01:19,376 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278437.bac638e560ad11510d3fe8810f826eb6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:19,376 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1694545278437.61858d79cc4cfde2a783e5cf59dbc6be.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:19,376 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:19,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-12 19:01:19,416 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6aaab45ae22f543230777c3ae2a8ba36, ASSIGN}] 2023-09-12 19:01:19,417 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6aaab45ae22f543230777c3ae2a8ba36, ASSIGN 2023-09-12 19:01:19,418 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6aaab45ae22f543230777c3ae2a8ba36, ASSIGN; state=MERGED, location=jenkins-hbase20.apache.org,38579,1694545208565; forceNewPlan=false, retain=false 2023-09-12 19:01:19,568 INFO [jenkins-hbase20:38069] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-12 19:01:19,573 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6aaab45ae22f543230777c3ae2a8ba36, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:19,573 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694545279572"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545279572"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545279572"}]},"ts":"1694545279572"} 2023-09-12 19:01:19,578 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 6aaab45ae22f543230777c3ae2a8ba36, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:01:19,696 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-12 19:01:19,737 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. 2023-09-12 19:01:19,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6aaab45ae22f543230777c3ae2a8ba36, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.', STARTKEY => '', ENDKEY => ''} 2023-09-12 19:01:19,737 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. service=AccessControlService 2023-09-12 19:01:19,738 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:01:19,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:19,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:19,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:19,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:19,741 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/.regioninfo 2023-09-12 19:01:19,752 INFO [StoreOpener-6aaab45ae22f543230777c3ae2a8ba36-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:19,753 DEBUG [StoreOpener-6aaab45ae22f543230777c3ae2a8ba36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf 2023-09-12 19:01:19,753 DEBUG [StoreOpener-6aaab45ae22f543230777c3ae2a8ba36-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf 2023-09-12 19:01:19,753 INFO [StoreOpener-6aaab45ae22f543230777c3ae2a8ba36-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6aaab45ae22f543230777c3ae2a8ba36 columnFamilyName cf 2023-09-12 19:01:19,777 DEBUG [StoreOpener-6aaab45ae22f543230777c3ae2a8ba36-1] regionserver.HStore(539): loaded hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf/797d9a258afa4c43aecf9677a5756b0e.bac638e560ad11510d3fe8810f826eb6->hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/cf/797d9a258afa4c43aecf9677a5756b0e-top 2023-09-12 19:01:19,784 DEBUG [StoreOpener-6aaab45ae22f543230777c3ae2a8ba36-1] regionserver.HStore(539): loaded hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf/9237453a5486400ba1f0235cf86e1958.61858d79cc4cfde2a783e5cf59dbc6be->hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/cf/9237453a5486400ba1f0235cf86e1958-top 2023-09-12 19:01:19,784 INFO [StoreOpener-6aaab45ae22f543230777c3ae2a8ba36-1] regionserver.HStore(310): Store=6aaab45ae22f543230777c3ae2a8ba36/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:01:19,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:19,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:19,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:19,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 6aaab45ae22f543230777c3ae2a8ba36; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62971426, jitterRate=-0.06165263056755066}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:01:19,790 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 6aaab45ae22f543230777c3ae2a8ba36: 2023-09-12 19:01:19,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36., pid=77, masterSystemTime=1694545279729 2023-09-12 19:01:19,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.,because compaction is disabled. 2023-09-12 19:01:19,793 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. 2023-09-12 19:01:19,793 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. 2023-09-12 19:01:19,793 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=6aaab45ae22f543230777c3ae2a8ba36, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:19,793 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694545279793"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545279793"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545279793"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545279793"}]},"ts":"1694545279793"} 2023-09-12 19:01:19,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-12 19:01:19,796 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 6aaab45ae22f543230777c3ae2a8ba36, server=jenkins-hbase20.apache.org,38579,1694545208565 in 217 msec 2023-09-12 19:01:19,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-12 19:01:19,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6aaab45ae22f543230777c3ae2a8ba36, ASSIGN in 380 msec 2023-09-12 19:01:19,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bac638e560ad11510d3fe8810f826eb6, 61858d79cc4cfde2a783e5cf59dbc6be], force=true in 715 msec 2023-09-12 19:01:20,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-12 19:01:20,200 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-12 19:01:20,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-12 19:01:20,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545280201 (current time:1694545280201). 2023-09-12 19:01:20,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:01:20,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x62208fe8 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:20,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@714c6073, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:20,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:20,222 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:20,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62208fe8 to 127.0.0.1:53172 2023-09-12 19:01:20,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:20,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x23d0b74b to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:20,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45693316, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:20,234 DEBUG [hconnection-0x57348c30-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:20,238 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:59974, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:20,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:20,248 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:40822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:20,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23d0b74b to 127.0.0.1:53172 2023-09-12 19:01:20,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:20,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-12 19:01:20,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:01:20,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-12 19:01:20,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-12 19:01:20,253 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-12 19:01:20,253 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1694545880253 2023-09-12 19:01:20,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-12 19:01:20,253 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,257 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:01:20,257 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:01:20,259 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-12 19:01:20,259 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-12 19:01:20,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 8 msec 2023-09-12 19:01:20,261 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-12 19:01:20,262 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1694545880262 2023-09-12 19:01:20,274 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,274 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-12 19:01:20,274 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:20,275 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-12 19:01:20,275 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-12 19:01:20,276 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,276 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,276 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:20,276 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:20,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:20,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:20,276 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,276 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:20,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,277 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,277 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:01:20,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,277 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,278 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-12 19:01:20,278 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,278 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,280 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-12 19:01:20,280 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-12 19:01:20,280 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:20,280 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-12 19:01:20,281 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-12 19:01:20,281 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-12 19:01:20,280 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-12 19:01:20,281 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-12 19:01:20,281 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:20,281 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-12 19:01:20,282 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-12 19:01:20,283 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-12 19:01:20,283 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-12 19:01:20,292 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,292 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,292 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,292 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,292 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,292 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,292 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,292 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:20,292 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:20,292 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:20,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:20,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:20,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:20,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-12 19:01:20,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@586babd7[Count = 0] remaining members to acquire global barrier 2023-09-12 19:01:20,294 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-12 19:01:20,294 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,295 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,295 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,295 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,295 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,295 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-12 19:01:20,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,295 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-12 19:01:20,295 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:01:20,295 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:20,295 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:20,295 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-12 19:01:20,295 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-12 19:01:20,295 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-12 19:01:20,295 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:01:20,295 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. 2023-09-12 19:01:20,295 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:01:20,296 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. started... 2023-09-12 19:01:20,297 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6aaab45ae22f543230777c3ae2a8ba36: 2023-09-12 19:01:20,297 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,297 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:20,297 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf/797d9a258afa4c43aecf9677a5756b0e.bac638e560ad11510d3fe8810f826eb6->hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/cf/797d9a258afa4c43aecf9677a5756b0e-top, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf/9237453a5486400ba1f0235cf86e1958.61858d79cc4cfde2a783e5cf59dbc6be->hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/cf/9237453a5486400ba1f0235cf86e1958-top] hfiles 2023-09-12 19:01:20,297 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf/797d9a258afa4c43aecf9677a5756b0e.bac638e560ad11510d3fe8810f826eb6 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,297 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-12 19:01:20,297 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-12 19:01:20,297 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:20,297 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:20,298 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-12 19:01:20,298 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-12 19:01:20,301 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf/9237453a5486400ba1f0235cf86e1958.61858d79cc4cfde2a783e5cf59dbc6be for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,309 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. completed. 2023-09-12 19:01:20,309 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. 2023-09-12 19:01:20,309 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:20,309 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:20,309 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,309 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-12 19:01:20,309 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:01:20,311 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-12 19:01:20,311 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,311 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:20,312 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-12 19:01:20,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:20,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:20,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:20,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:20,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:20,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:20,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:20,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:20,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:20,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase20.apache.org,38579,1694545208565': 2023-09-12 19:01:20,315 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-12 19:01:20,315 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-12 19:01:20,316 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:01:20,316 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:01:20,316 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,316 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:01:20,324 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,324 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:20,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:20,324 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,324 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:20,324 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,324 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:20,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,324 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:20,325 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:20,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:20,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:20,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:20,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:20,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:20,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:20,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:20,326 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,327 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:20,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:20,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:20,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:20,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:20,333 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:20,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,333 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:20,334 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:20,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:20,342 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:20,342 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:20,342 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:20,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:20,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:20,342 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:20,342 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:20,342 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:20,342 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:20,342 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:20,342 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,342 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:20,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:20,342 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,342 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:20,343 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:20,343 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,343 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:20,343 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,343 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:20,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:20,343 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:20,343 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,343 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,343 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:20,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:20,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,358 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,359 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:20,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-12 19:01:20,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,360 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1694545280253Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694545280342 (+89 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694545280342Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694545280345 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1694545280352 (+7 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1694545280359 (+7 ms) 2023-09-12 19:01:20,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-12 19:01:20,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:01:20,362 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-12 19:01:20,363 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545280363 2023-09-12 19:01:20,363 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36845, tgtDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545280363, rawTgtDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545280363, srcFsUri=hdfs://localhost:36845, srcDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:01:20,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 105 msec 2023-09-12 19:01:20,380 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:01:20,381 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-702725331_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545280363, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545280363/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,381 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0, snapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-12 19:01:20,389 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545280363/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:20,407 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:20,407 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:20,408 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:20,408 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:21,110 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-2160303577222884332.jar 2023-09-12 19:01:21,111 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:21,111 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:21,194 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-2840433208184801577.jar 2023-09-12 19:01:21,194 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:21,195 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:21,195 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:21,195 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:21,196 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:21,196 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:21,196 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 19:01:21,197 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 19:01:21,197 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 19:01:21,197 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 19:01:21,197 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 19:01:21,198 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 19:01:21,198 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 19:01:21,198 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 19:01:21,199 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 19:01:21,199 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 19:01:21,199 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:21,200 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:21,200 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:21,200 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:21,201 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:21,201 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:21,201 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:21,554 WARN [Listener at jenkins-hbase20.apache.org/37289] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 19:01:21,556 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-12 19:01:21,558 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-12 19:01:21,824 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:01:21,824 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:01:21,827 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0004_000001 (auth:SIMPLE) 2023-09-12 19:01:22,514 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 19:01:22,668 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0005_000001 (auth:SIMPLE) 2023-09-12 19:01:25,941 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0005_000001 (auth:SIMPLE) 2023-09-12 19:01:28,141 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0005_000001 (auth:SIMPLE) 2023-09-12 19:01:30,208 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0005_000001 (auth:SIMPLE) 2023-09-12 19:01:31,734 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 19:01:31,736 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 19:01:31,744 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:31,744 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 19:01:31,745 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 19:01:31,745 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:31,746 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-12 19:01:31,746 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-12 19:01:31,746 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545280363/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545280363/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:31,747 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545280363/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-12 19:01:31,747 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545280363/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-12 19:01:31,754 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:31,755 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:31,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:31,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-12 19:01:31,760 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545291760"}]},"ts":"1694545291760"} 2023-09-12 19:01:31,761 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-12 19:01:31,763 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-12 19:01:31,764 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6aaab45ae22f543230777c3ae2a8ba36, UNASSIGN}] 2023-09-12 19:01:31,765 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6aaab45ae22f543230777c3ae2a8ba36, UNASSIGN 2023-09-12 19:01:31,766 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6aaab45ae22f543230777c3ae2a8ba36, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:31,766 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694545291765"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545291765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545291765"}]},"ts":"1694545291765"} 2023-09-12 19:01:31,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 6aaab45ae22f543230777c3ae2a8ba36, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:01:31,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-12 19:01:31,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:31,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6aaab45ae22f543230777c3ae2a8ba36, disabling compactions & flushes 2023-09-12 19:01:31,920 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. 2023-09-12 19:01:31,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. 2023-09-12 19:01:31,920 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. after waiting 0 ms 2023-09-12 19:01:31,921 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. 2023-09-12 19:01:31,937 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-12 19:01:31,938 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:31,939 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36. 2023-09-12 19:01:31,939 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6aaab45ae22f543230777c3ae2a8ba36: 2023-09-12 19:01:31,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:31,942 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=6aaab45ae22f543230777c3ae2a8ba36, regionState=CLOSED 2023-09-12 19:01:31,942 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1694545291942"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545291942"}]},"ts":"1694545291942"} 2023-09-12 19:01:31,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-12 19:01:31,944 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 6aaab45ae22f543230777c3ae2a8ba36, server=jenkins-hbase20.apache.org,38579,1694545208565 in 175 msec 2023-09-12 19:01:31,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-12 19:01:31,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=6aaab45ae22f543230777c3ae2a8ba36, UNASSIGN in 180 msec 2023-09-12 19:01:31,946 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545291946"}]},"ts":"1694545291946"} 2023-09-12 19:01:31,948 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-12 19:01:31,949 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-12 19:01:31,950 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 194 msec 2023-09-12 19:01:32,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-12 19:01:32,065 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-12 19:01:32,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,071 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,072 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,075 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,076 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,076 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,077 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,077 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-12 19:01:32,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-12 19:01:32,077 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-09-12 19:01:32,078 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,078 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:32,078 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,078 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:32,079 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,079 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:32,079 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:32,079 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:32,078 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:32,079 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:32,078 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-12 19:01:32,079 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-12 19:01:32,080 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:32,080 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:32,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-12 19:01:32,080 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:32,080 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:32,081 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/recovered.edits] 2023-09-12 19:01:32,081 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/recovered.edits] 2023-09-12 19:01:32,081 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/recovered.edits] 2023-09-12 19:01:32,084 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/cf/9237453a5486400ba1f0235cf86e1958 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/cf/9237453a5486400ba1f0235cf86e1958 2023-09-12 19:01:32,084 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf/797d9a258afa4c43aecf9677a5756b0e.bac638e560ad11510d3fe8810f826eb6 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf/797d9a258afa4c43aecf9677a5756b0e.bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:32,085 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/cf/797d9a258afa4c43aecf9677a5756b0e to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/cf/797d9a258afa4c43aecf9677a5756b0e 2023-09-12 19:01:32,086 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf/9237453a5486400ba1f0235cf86e1958.61858d79cc4cfde2a783e5cf59dbc6be to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/cf/9237453a5486400ba1f0235cf86e1958.61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:32,087 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/recovered.edits/8.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be/recovered.edits/8.seqid 2023-09-12 19:01:32,087 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/recovered.edits/8.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6/recovered.edits/8.seqid 2023-09-12 19:01:32,087 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/61858d79cc4cfde2a783e5cf59dbc6be 2023-09-12 19:01:32,088 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bac638e560ad11510d3fe8810f826eb6 2023-09-12 19:01:32,088 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/recovered.edits/12.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36/recovered.edits/12.seqid 2023-09-12 19:01:32,089 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/6aaab45ae22f543230777c3ae2a8ba36 2023-09-12 19:01:32,089 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-12 19:01:32,090 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,093 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-12 19:01:32,094 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-12 19:01:32,095 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,095 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-12 19:01:32,096 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545292095"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:32,097 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-12 19:01:32,097 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6aaab45ae22f543230777c3ae2a8ba36, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1694545278438.6aaab45ae22f543230777c3ae2a8ba36.', STARTKEY => '', ENDKEY => ''}] 2023-09-12 19:01:32,097 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-12 19:01:32,097 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694545292097"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:32,099 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-12 19:01:32,100 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 34 msec 2023-09-12 19:01:32,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-12 19:01:32,182 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-12 19:01:32,184 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,184 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-12 19:01:32,193 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545292193"}]},"ts":"1694545292193"} 2023-09-12 19:01:32,195 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-12 19:01:32,197 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-12 19:01:32,198 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d5d1930963ee18eed4e6d1d7fb97cd53, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6fab29979398f7f84e1d95919f99b148, UNASSIGN}] 2023-09-12 19:01:32,199 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6fab29979398f7f84e1d95919f99b148, UNASSIGN 2023-09-12 19:01:32,200 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d5d1930963ee18eed4e6d1d7fb97cd53, UNASSIGN 2023-09-12 19:01:32,201 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d5d1930963ee18eed4e6d1d7fb97cd53, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:32,201 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6fab29979398f7f84e1d95919f99b148, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:32,201 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694545292201"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545292201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545292201"}]},"ts":"1694545292201"} 2023-09-12 19:01:32,201 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694545292201"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545292201"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545292201"}]},"ts":"1694545292201"} 2023-09-12 19:01:32,202 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=86, state=RUNNABLE; CloseRegionProcedure 6fab29979398f7f84e1d95919f99b148, server=jenkins-hbase20.apache.org,42275,1694545208517}] 2023-09-12 19:01:32,203 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=85, state=RUNNABLE; CloseRegionProcedure d5d1930963ee18eed4e6d1d7fb97cd53, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:01:32,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-12 19:01:32,355 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:32,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 6fab29979398f7f84e1d95919f99b148, disabling compactions & flushes 2023-09-12 19:01:32,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:32,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:32,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. after waiting 0 ms 2023-09-12 19:01:32,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:32,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing d5d1930963ee18eed4e6d1d7fb97cd53, disabling compactions & flushes 2023-09-12 19:01:32,357 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:32,357 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. after waiting 0 ms 2023-09-12 19:01:32,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:32,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:01:32,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:01:32,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:32,377 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:32,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53. 2023-09-12 19:01:32,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148. 2023-09-12 19:01:32,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for d5d1930963ee18eed4e6d1d7fb97cd53: 2023-09-12 19:01:32,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 6fab29979398f7f84e1d95919f99b148: 2023-09-12 19:01:32,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:32,381 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=6fab29979398f7f84e1d95919f99b148, regionState=CLOSED 2023-09-12 19:01:32,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:32,381 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694545292381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545292381"}]},"ts":"1694545292381"} 2023-09-12 19:01:32,381 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=d5d1930963ee18eed4e6d1d7fb97cd53, regionState=CLOSED 2023-09-12 19:01:32,382 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1694545292381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545292381"}]},"ts":"1694545292381"} 2023-09-12 19:01:32,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=86 2023-09-12 19:01:32,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=86, state=SUCCESS; CloseRegionProcedure 6fab29979398f7f84e1d95919f99b148, server=jenkins-hbase20.apache.org,42275,1694545208517 in 180 msec 2023-09-12 19:01:32,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=85 2023-09-12 19:01:32,385 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=85, state=SUCCESS; CloseRegionProcedure d5d1930963ee18eed4e6d1d7fb97cd53, server=jenkins-hbase20.apache.org,38579,1694545208565 in 180 msec 2023-09-12 19:01:32,385 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=6fab29979398f7f84e1d95919f99b148, UNASSIGN in 186 msec 2023-09-12 19:01:32,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=85, resume processing ppid=84 2023-09-12 19:01:32,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=d5d1930963ee18eed4e6d1d7fb97cd53, UNASSIGN in 187 msec 2023-09-12 19:01:32,387 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545292387"}]},"ts":"1694545292387"} 2023-09-12 19:01:32,388 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-12 19:01:32,389 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-12 19:01:32,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 205 msec 2023-09-12 19:01:32,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-12 19:01:32,496 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-12 19:01:32,497 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,500 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,500 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,501 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,502 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,504 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,504 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,504 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,504 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,506 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:32,506 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:32,506 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-12 19:01:32,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-12 19:01:32,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-12 19:01:32,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:32,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:32,507 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-09-12 19:01:32,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:32,507 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-12 19:01:32,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:32,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-12 19:01:32,509 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/recovered.edits] 2023-09-12 19:01:32,509 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/recovered.edits] 2023-09-12 19:01:32,512 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/cf/c8803b764b3a495fa5abf4f0fec81042 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/cf/c8803b764b3a495fa5abf4f0fec81042 2023-09-12 19:01:32,512 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/cf/b2e3d2f65f0c4637b1c353db50b58a73 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/cf/b2e3d2f65f0c4637b1c353db50b58a73 2023-09-12 19:01:32,515 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53/recovered.edits/9.seqid 2023-09-12 19:01:32,515 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148/recovered.edits/9.seqid 2023-09-12 19:01:32,516 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/d5d1930963ee18eed4e6d1d7fb97cd53 2023-09-12 19:01:32,516 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/6fab29979398f7f84e1d95919f99b148 2023-09-12 19:01:32,516 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-12 19:01:32,516 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-12 19:01:32,517 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-12 19:01:32,520 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309121d054572d6ff47f5a62d39f1b4441ac4 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b202309121d054572d6ff47f5a62d39f1b4441ac4 2023-09-12 19:01:32,521 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230912f2509fb8062449ab8b52600eca6fbf45 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230912f2509fb8062449ab8b52600eca6fbf45 2023-09-12 19:01:32,521 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-12 19:01:32,523 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,525 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-12 19:01:32,526 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-12 19:01:32,527 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,527 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-12 19:01:32,527 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545292527"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:32,527 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545292527"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:32,529 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 19:01:32,529 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d5d1930963ee18eed4e6d1d7fb97cd53, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1694545277233.d5d1930963ee18eed4e6d1d7fb97cd53.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6fab29979398f7f84e1d95919f99b148, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1694545277233.6fab29979398f7f84e1d95919f99b148.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 19:01:32,529 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-12 19:01:32,529 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694545292529"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:32,530 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-12 19:01:32,540 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,541 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 43 msec 2023-09-12 19:01:32,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-12 19:01:32,611 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-12 19:01:32,631 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-12 19:01:32,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-12 19:01:32,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-12 19:01:32,639 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-12 19:01:32,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-12 19:01:32,670 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=763 (was 758) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:49778 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:44573 from appattempt_1694545214673_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:35478 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1919690698_1 at /127.0.0.1:49766 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4190 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1919690698_1 at /127.0.0.1:35450 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:37771 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:41394 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=916 (was 923), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=134 (was 153), ProcessCount=167 (was 167), AvailableMemoryMB=1847 (was 1945) 2023-09-12 19:01:32,671 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=763 is superior to 500 2023-09-12 19:01:32,688 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=762, OpenFileDescriptor=914, MaxFileDescriptor=60000, SystemLoadAverage=134, ProcessCount=167, AvailableMemoryMB=1846 2023-09-12 19:01:32,688 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-09-12 19:01:32,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 19:01:32,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 19:01:32,693 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 19:01:32,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-12 19:01:32,694 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 19:01:32,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-12 19:01:32,696 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:32,696 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:32,696 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e empty. 2023-09-12 19:01:32,696 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830 empty. 2023-09-12 19:01:32,697 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:32,697 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:32,697 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-12 19:01:32,706 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-12 19:01:32,707 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4ce78189d842b831503a667fb842a34e, NAME => 'testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:01:32,707 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c28b6a1ef7fc969d64bc83d99f6d6830, NAME => 'testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 4ce78189d842b831503a667fb842a34e, disabling compactions & flushes 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c28b6a1ef7fc969d64bc83d99f6d6830, disabling compactions & flushes 2023-09-12 19:01:32,729 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:32,729 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. after waiting 0 ms 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. after waiting 0 ms 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:32,729 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:32,729 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 4ce78189d842b831503a667fb842a34e: 2023-09-12 19:01:32,729 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c28b6a1ef7fc969d64bc83d99f6d6830: 2023-09-12 19:01:32,731 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 19:01:32,732 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694545292732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545292732"}]},"ts":"1694545292732"} 2023-09-12 19:01:32,732 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694545292732"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545292732"}]},"ts":"1694545292732"} 2023-09-12 19:01:32,734 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 19:01:32,735 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 19:01:32,735 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545292735"}]},"ts":"1694545292735"} 2023-09-12 19:01:32,736 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-12 19:01:32,739 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-12 19:01:32,740 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 19:01:32,740 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 19:01:32,740 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 19:01:32,740 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 19:01:32,741 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4ce78189d842b831503a667fb842a34e, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c28b6a1ef7fc969d64bc83d99f6d6830, ASSIGN}] 2023-09-12 19:01:32,743 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c28b6a1ef7fc969d64bc83d99f6d6830, ASSIGN 2023-09-12 19:01:32,743 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4ce78189d842b831503a667fb842a34e, ASSIGN 2023-09-12 19:01:32,744 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c28b6a1ef7fc969d64bc83d99f6d6830, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,38579,1694545208565; forceNewPlan=false, retain=false 2023-09-12 19:01:32,744 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4ce78189d842b831503a667fb842a34e, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36759,1694545208602; forceNewPlan=false, retain=false 2023-09-12 19:01:32,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-12 19:01:32,894 INFO [jenkins-hbase20:38069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 19:01:32,900 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4ce78189d842b831503a667fb842a34e, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:32,900 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c28b6a1ef7fc969d64bc83d99f6d6830, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:32,900 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694545292900"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545292900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545292900"}]},"ts":"1694545292900"} 2023-09-12 19:01:32,901 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694545292900"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545292900"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545292900"}]},"ts":"1694545292900"} 2023-09-12 19:01:32,904 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 4ce78189d842b831503a667fb842a34e, server=jenkins-hbase20.apache.org,36759,1694545208602}] 2023-09-12 19:01:32,906 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure c28b6a1ef7fc969d64bc83d99f6d6830, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:01:32,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-12 19:01:33,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:33,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:33,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4ce78189d842b831503a667fb842a34e, NAME => 'testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 19:01:33,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c28b6a1ef7fc969d64bc83d99f6d6830, NAME => 'testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 19:01:33,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. service=AccessControlService 2023-09-12 19:01:33,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. service=AccessControlService 2023-09-12 19:01:33,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:01:33,075 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:01:33,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:33,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:33,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:33,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:33,077 INFO [StoreOpener-4ce78189d842b831503a667fb842a34e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:33,077 INFO [StoreOpener-c28b6a1ef7fc969d64bc83d99f6d6830-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:33,078 DEBUG [StoreOpener-4ce78189d842b831503a667fb842a34e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/cf 2023-09-12 19:01:33,078 DEBUG [StoreOpener-4ce78189d842b831503a667fb842a34e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/cf 2023-09-12 19:01:33,078 DEBUG [StoreOpener-c28b6a1ef7fc969d64bc83d99f6d6830-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/cf 2023-09-12 19:01:33,078 DEBUG [StoreOpener-c28b6a1ef7fc969d64bc83d99f6d6830-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/cf 2023-09-12 19:01:33,078 INFO [StoreOpener-4ce78189d842b831503a667fb842a34e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4ce78189d842b831503a667fb842a34e columnFamilyName cf 2023-09-12 19:01:33,079 INFO [StoreOpener-c28b6a1ef7fc969d64bc83d99f6d6830-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c28b6a1ef7fc969d64bc83d99f6d6830 columnFamilyName cf 2023-09-12 19:01:33,080 INFO [StoreOpener-c28b6a1ef7fc969d64bc83d99f6d6830-1] regionserver.HStore(310): Store=c28b6a1ef7fc969d64bc83d99f6d6830/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:01:33,080 INFO [StoreOpener-4ce78189d842b831503a667fb842a34e-1] regionserver.HStore(310): Store=4ce78189d842b831503a667fb842a34e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:01:33,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:33,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:33,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:33,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:33,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:33,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:33,086 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:01:33,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 4ce78189d842b831503a667fb842a34e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66301977, jitterRate=-0.012023553252220154}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:01:33,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 4ce78189d842b831503a667fb842a34e: 2023-09-12 19:01:33,088 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e., pid=93, masterSystemTime=1694545293057 2023-09-12 19:01:33,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:01:33,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened c28b6a1ef7fc969d64bc83d99f6d6830; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72517675, jitterRate=0.08059756457805634}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:01:33,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for c28b6a1ef7fc969d64bc83d99f6d6830: 2023-09-12 19:01:33,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830., pid=94, masterSystemTime=1694545293064 2023-09-12 19:01:33,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:33,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:33,092 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=4ce78189d842b831503a667fb842a34e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:33,092 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694545293091"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545293091"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545293091"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545293091"}]},"ts":"1694545293091"} 2023-09-12 19:01:33,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:33,092 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=c28b6a1ef7fc969d64bc83d99f6d6830, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,092 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694545293092"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545293092"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545293092"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545293092"}]},"ts":"1694545293092"} 2023-09-12 19:01:33,094 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=91 2023-09-12 19:01:33,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 4ce78189d842b831503a667fb842a34e, server=jenkins-hbase20.apache.org,36759,1694545208602 in 189 msec 2023-09-12 19:01:33,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=92 2023-09-12 19:01:33,095 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure c28b6a1ef7fc969d64bc83d99f6d6830, server=jenkins-hbase20.apache.org,38579,1694545208565 in 188 msec 2023-09-12 19:01:33,096 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4ce78189d842b831503a667fb842a34e, ASSIGN in 355 msec 2023-09-12 19:01:33,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-12 19:01:33,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c28b6a1ef7fc969d64bc83d99f6d6830, ASSIGN in 355 msec 2023-09-12 19:01:33,097 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 19:01:33,097 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545293097"}]},"ts":"1694545293097"} 2023-09-12 19:01:33,098 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-12 19:01:33,100 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 19:01:33,100 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-12 19:01:33,102 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 19:01:33,103 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:33,103 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:33,103 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:33,103 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:33,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:33,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:33,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:33,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:33,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 414 msec 2023-09-12 19:01:33,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-12 19:01:33,300 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-12 19:01:33,302 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-12 19:01:33,302 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:33,304 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:01:33,317 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:01:33,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545293317 (current time:1694545293317). 2023-09-12 19:01:33,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:01:33,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x461c21cc to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:33,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f3d503b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:33,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:33,333 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:33,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x461c21cc to 127.0.0.1:53172 2023-09-12 19:01:33,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:33,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x2de0db2c to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:33,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a558d1d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:33,343 DEBUG [hconnection-0x2fcca8e4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:33,344 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42072, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:33,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:33,352 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33470, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:33,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2de0db2c to 127.0.0.1:53172 2023-09-12 19:01:33,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:33,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 19:01:33,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:01:33,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:01:33,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:01:33,358 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:01:33,359 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694545893359 2023-09-12 19:01:33,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-12 19:01:33,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:01:33,361 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:01:33,361 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:01:33,362 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:01:33,363 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 19:01:33,363 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-12 19:01:33,367 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 19:01:33,367 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694545893367 2023-09-12 19:01:33,376 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,376 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-12 19:01:33,376 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:33,378 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-12 19:01:33,378 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-12 19:01:33,378 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,378 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,381 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:33,381 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:33,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:33,381 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:33,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:33,381 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:33,381 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:33,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,382 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,382 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,382 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,382 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,382 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:01:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-12 19:01:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-12 19:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,383 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 19:01:33,383 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 19:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-12 19:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,383 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 19:01:33,383 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 19:01:33,383 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,383 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:33,383 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 19:01:33,383 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:33,384 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,385 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 19:01:33,385 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 19:01:33,385 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:33,385 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 19:01:33,386 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 19:01:33,386 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 19:01:33,386 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 19:01:33,385 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 19:01:33,386 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 19:01:33,386 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 19:01:33,386 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 19:01:33,392 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,392 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,392 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,392 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:33,392 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,392 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,392 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:33,392 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,392 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:33,392 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,392 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:33,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-12 19:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d052697[Count = 1] remaining members to acquire global barrier 2023-09-12 19:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:33,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-12 19:01:33,396 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6d052697[Count = 0] remaining members to acquire global barrier 2023-09-12 19:01:33,396 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-12 19:01:33,396 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,397 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,397 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,397 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,397 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,397 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:01:33,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,397 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 19:01:33,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,397 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:01:33,397 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,397 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,397 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:01:33,397 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:01:33,397 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:33,397 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:33,397 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:33,398 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:33,397 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:33,398 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:33,398 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. started... 2023-09-12 19:01:33,398 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. started... 2023-09-12 19:01:33,399 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c28b6a1ef7fc969d64bc83d99f6d6830: 2023-09-12 19:01:33,399 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 19:01:33,399 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ce78189d842b831503a667fb842a34e: 2023-09-12 19:01:33,399 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,399 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:33,399 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:33,399 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,399 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:01:33,400 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:33,399 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 19:01:33,400 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:01:33,413 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. completed. 2023-09-12 19:01:33,413 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:33,413 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:33,413 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:33,413 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,413 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 19:01:33,413 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:01:33,414 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. completed. 2023-09-12 19:01:33,414 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:33,415 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:33,415 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:33,415 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,415 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 19:01:33,415 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:01:33,424 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 19:01:33,425 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:33,425 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 19:01:33,425 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:33,426 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:33,426 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 19:01:33,427 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:33,427 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 19:01:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,36759,1694545208602': 2023-09-12 19:01:33,431 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-12 19:01:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:33,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:33,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,38579,1694545208565': 2023-09-12 19:01:33,435 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-12 19:01:33,435 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-12 19:01:33,435 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:01:33,435 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:01:33,435 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,435 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:01:33,443 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,443 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,443 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:33,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,443 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:33,443 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,443 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,443 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:33,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,444 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:33,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:33,444 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,444 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:33,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,445 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:33,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,447 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:33,448 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,448 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,449 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:33,458 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:33,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:33,458 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,460 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,458 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:33,460 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:33,458 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:33,460 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:33,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:33,459 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-12 19:01:33,461 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,461 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:33,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:33,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:33,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:33,461 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,461 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:01:33,461 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:33,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:33,462 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 19:01:33,463 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:33,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:01:33,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:01:33,464 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:01:33,472 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,473 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,496 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-12 19:01:33,497 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,498 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,498 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694545293359Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694545293472 (+113 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694545293472Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1694545293473 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1694545293477 (+4 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1694545293488 (+11 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694545293497 (+9 ms) 2023-09-12 19:01:33,502 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 19:01:33,504 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 141 msec 2023-09-12 19:01:33,664 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:33,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:01:33,667 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:01:33,675 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36759] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:01:33,678 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38579] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:01:33,681 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-12 19:01:33,681 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:33,681 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:01:33,690 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:01:33,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545293690 (current time:1694545293690). 2023-09-12 19:01:33,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:01:33,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x333f169d to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:33,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@797e1396, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:33,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:33,699 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42088, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:33,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x333f169d to 127.0.0.1:53172 2023-09-12 19:01:33,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:33,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x46f937d4 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:33,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@db94a68, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:33,710 DEBUG [hconnection-0x4521aea-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:33,713 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:42098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:33,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:33,718 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:33478, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:33,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x46f937d4 to 127.0.0.1:53172 2023-09-12 19:01:33,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:33,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-12 19:01:33,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:01:33,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:01:33,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:01:33,723 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:01:33,724 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1694545893724 2023-09-12 19:01:33,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-12 19:01:33,724 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-12 19:01:33,725 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:01:33,725 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:01:33,727 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-12 19:01:33,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 19:01:33,728 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-09-12 19:01:33,729 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 19:01:33,729 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1694545893729 2023-09-12 19:01:33,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,738 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-12 19:01:33,738 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:33,740 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-12 19:01:33,740 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-12 19:01:33,740 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,740 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,741 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:33,741 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:33,741 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:33,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:33,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:33,741 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:33,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:33,741 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,741 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,742 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,742 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,742 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 19:01:33,742 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 19:01:33,742 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,742 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:33,742 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-12 19:01:33,742 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:33,744 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:33,743 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 19:01:33,747 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 19:01:33,747 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 19:01:33,747 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 19:01:33,747 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 19:01:33,744 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-12 19:01:33,747 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 19:01:33,747 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-12 19:01:33,747 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-12 19:01:33,750 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,750 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,750 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,750 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,751 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,751 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:33,751 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:33,751 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,751 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:33,751 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,751 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:33,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:33,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-12 19:01:33,753 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b6592c[Count = 1] remaining members to acquire global barrier 2023-09-12 19:01:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:33,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:33,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:33,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-12 19:01:33,755 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@43b6592c[Count = 0] remaining members to acquire global barrier 2023-09-12 19:01:33,755 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-12 19:01:33,755 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,756 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,756 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,756 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,757 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,756 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,757 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:01:33,757 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:01:33,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,757 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-12 19:01:33,757 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 19:01:33,757 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:33,757 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:33,757 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:33,757 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:33,757 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:33,757 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. started... 2023-09-12 19:01:33,757 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. started... 2023-09-12 19:01:33,757 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,757 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:01:33,757 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:33,757 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:01:33,757 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c28b6a1ef7fc969d64bc83d99f6d6830 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-09-12 19:01:33,757 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4ce78189d842b831503a667fb842a34e 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-09-12 19:01:33,758 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 19:01:33,758 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:33,758 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 19:01:33,783 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230912ba0c5e97e68e4ad7a839d497f51a8f58 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230912ba0c5e97e68e4ad7a839d497f51a8f58 2023-09-12 19:01:33,794 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=400, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/.tmp/cf/a5d1a588e004433b9324e0cf8435b50a 2023-09-12 19:01:33,798 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/.tmp/cf/a5d1a588e004433b9324e0cf8435b50a as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/cf/a5d1a588e004433b9324e0cf8435b50a 2023-09-12 19:01:33,804 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/cf/a5d1a588e004433b9324e0cf8435b50a, entries=6, sequenceid=6, filesize=5.9 K 2023-09-12 19:01:33,805 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for 4ce78189d842b831503a667fb842a34e in 47ms, sequenceid=6, compaction requested=false 2023-09-12 19:01:33,805 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-12 19:01:33,805 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4ce78189d842b831503a667fb842a34e: 2023-09-12 19:01:33,805 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,807 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:33,807 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/cf/a5d1a588e004433b9324e0cf8435b50a] hfiles 2023-09-12 19:01:33,807 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/cf/a5d1a588e004433b9324e0cf8435b50a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,814 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. completed. 2023-09-12 19:01:33,814 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:33,814 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:33,814 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:33,814 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,814 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 19:01:33,814 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:01:33,815 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,815 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 19:01:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:33,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:33,815 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:33,816 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 19:01:33,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:33,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:33,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:33,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,36759,1694545208602': 2023-09-12 19:01:33,820 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-12 19:01:33,826 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:33,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:01:33,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:01:33,827 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:01:34,027 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:34,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:01:34,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:01:34,031 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-12 19:01:34,193 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230912148baf561db146b0995e5040f21aae46 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230912148baf561db146b0995e5040f21aae46 2023-09-12 19:01:34,202 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/.tmp/cf/aabd3ac69bff4b10b03b0a29166c9867 2023-09-12 19:01:34,207 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/.tmp/cf/aabd3ac69bff4b10b03b0a29166c9867 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/cf/aabd3ac69bff4b10b03b0a29166c9867 2023-09-12 19:01:34,212 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/cf/aabd3ac69bff4b10b03b0a29166c9867, entries=44, sequenceid=6, filesize=12.6 K 2023-09-12 19:01:34,212 INFO [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for c28b6a1ef7fc969d64bc83d99f6d6830 in 455ms, sequenceid=6, compaction requested=false 2023-09-12 19:01:34,214 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c28b6a1ef7fc969d64bc83d99f6d6830: 2023-09-12 19:01:34,214 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,214 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:34,214 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/cf/aabd3ac69bff4b10b03b0a29166c9867] hfiles 2023-09-12 19:01:34,214 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/cf/aabd3ac69bff4b10b03b0a29166c9867 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,223 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. completed. 2023-09-12 19:01:34,223 DEBUG [rs(jenkins-hbase20.apache.org,38579,1694545208565)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:34,223 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:34,223 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:34,223 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,223 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-12 19:01:34,223 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:01:34,225 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,225 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-12 19:01:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:34,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:34,225 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:34,225 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-12 19:01:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:34,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:34,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:34,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:34,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:34,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:34,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase20.apache.org,38579,1694545208565': 2023-09-12 19:01:34,232 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-12 19:01:34,232 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-12 19:01:34,232 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:01:34,232 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:01:34,232 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,232 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:01:34,240 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:34,240 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:34,240 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:34,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,240 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:34,240 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:34,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:34,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:34,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,241 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,241 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:34,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:34,242 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:34,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:34,243 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,243 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:34,249 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:34,249 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,250 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:34,250 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:34,250 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:34,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:34,250 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:34,250 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:34,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:34,250 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,251 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:34,250 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:34,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:34,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:34,251 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:34,250 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,252 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-12 19:01:34,251 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:34,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:34,251 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:34,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:34,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,252 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:01:34,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:34,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:34,252 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:34,252 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:34,252 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,252 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230912148baf561db146b0995e5040f21aae46, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230912ba0c5e97e68e4ad7a839d497f51a8f58] mob files 2023-09-12 19:01:34,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230912148baf561db146b0995e5040f21aae46 2023-09-12 19:01:34,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230912ba0c5e97e68e4ad7a839d497f51a8f58 2023-09-12 19:01:34,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,286 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-12 19:01:34,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,286 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,287 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1694545293724Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1694545294261 (+537 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1694545294261Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1694545294261Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1694545294271 (+10 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1694545294280 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1694545294286 (+6 ms) 2023-09-12 19:01:34,292 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-12 19:01:34,293 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 567 msec 2023-09-12 19:01:34,331 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:34,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-12 19:01:34,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:01:34,333 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545294333 2023-09-12 19:01:34,333 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36845, tgtDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545294333, rawTgtDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545294333, srcFsUri=hdfs://localhost:36845, srcDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:01:34,355 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:01:34,355 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1308975933_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545294333, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545294333/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,355 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0, snapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-12 19:01:34,360 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545294333/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:34,385 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:34,386 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:34,386 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:34,386 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:35,086 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-3021264235490207762.jar 2023-09-12 19:01:35,086 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:35,086 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:35,139 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-8187835276445732823.jar 2023-09-12 19:01:35,140 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:35,140 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:35,140 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:35,141 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:35,141 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:35,141 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:35,141 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 19:01:35,142 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 19:01:35,142 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 19:01:35,142 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 19:01:35,143 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 19:01:35,143 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 19:01:35,143 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 19:01:35,144 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 19:01:35,144 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 19:01:35,144 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 19:01:35,145 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:35,145 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:35,145 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:35,145 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:35,146 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:35,146 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:35,146 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:35,478 WARN [Listener at jenkins-hbase20.apache.org/37289] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 19:01:35,481 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-12 19:01:36,402 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:01:36,402 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:01:36,405 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0005_000001 (auth:SIMPLE) 2023-09-12 19:01:36,843 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0006_000001 (auth:SIMPLE) 2023-09-12 19:01:37,520 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 19:01:40,255 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0006_000001 (auth:SIMPLE) 2023-09-12 19:01:42,848 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 19:01:42,849 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 19:01:42,854 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:42,854 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 19:01:42,855 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 19:01:42,855 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:42,855 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-12 19:01:42,855 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-12 19:01:42,855 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545294333/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545294333/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:42,856 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545294333/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-12 19:01:42,856 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545294333/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-12 19:01:42,861 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-12 19:01:42,861 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testEmptyExportFileSystemState 2023-09-12 19:01:42,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 19:01:42,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-12 19:01:42,865 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545302865"}]},"ts":"1694545302865"} 2023-09-12 19:01:42,867 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-12 19:01:42,928 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-12 19:01:42,929 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4ce78189d842b831503a667fb842a34e, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c28b6a1ef7fc969d64bc83d99f6d6830, UNASSIGN}] 2023-09-12 19:01:42,933 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c28b6a1ef7fc969d64bc83d99f6d6830, UNASSIGN 2023-09-12 19:01:42,933 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4ce78189d842b831503a667fb842a34e, UNASSIGN 2023-09-12 19:01:42,934 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c28b6a1ef7fc969d64bc83d99f6d6830, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:42,934 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4ce78189d842b831503a667fb842a34e, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:42,934 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694545302934"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545302934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545302934"}]},"ts":"1694545302934"} 2023-09-12 19:01:42,934 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694545302934"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545302934"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545302934"}]},"ts":"1694545302934"} 2023-09-12 19:01:42,937 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure c28b6a1ef7fc969d64bc83d99f6d6830, server=jenkins-hbase20.apache.org,38579,1694545208565}] 2023-09-12 19:01:42,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 4ce78189d842b831503a667fb842a34e, server=jenkins-hbase20.apache.org,36759,1694545208602}] 2023-09-12 19:01:42,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-12 19:01:43,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:43,090 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:43,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 4ce78189d842b831503a667fb842a34e, disabling compactions & flushes 2023-09-12 19:01:43,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:43,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing c28b6a1ef7fc969d64bc83d99f6d6830, disabling compactions & flushes 2023-09-12 19:01:43,091 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:43,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:43,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. after waiting 0 ms 2023-09-12 19:01:43,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:43,091 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:43,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. after waiting 0 ms 2023-09-12 19:01:43,092 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:43,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:01:43,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:01:43,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:43,108 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:43,109 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830. 2023-09-12 19:01:43,110 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e. 2023-09-12 19:01:43,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for c28b6a1ef7fc969d64bc83d99f6d6830: 2023-09-12 19:01:43,110 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 4ce78189d842b831503a667fb842a34e: 2023-09-12 19:01:43,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:43,112 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=4ce78189d842b831503a667fb842a34e, regionState=CLOSED 2023-09-12 19:01:43,112 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694545303112"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545303112"}]},"ts":"1694545303112"} 2023-09-12 19:01:43,112 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:43,113 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=c28b6a1ef7fc969d64bc83d99f6d6830, regionState=CLOSED 2023-09-12 19:01:43,113 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1694545303113"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545303113"}]},"ts":"1694545303113"} 2023-09-12 19:01:43,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=100 2023-09-12 19:01:43,116 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 4ce78189d842b831503a667fb842a34e, server=jenkins-hbase20.apache.org,36759,1694545208602 in 176 msec 2023-09-12 19:01:43,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=101 2023-09-12 19:01:43,119 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4ce78189d842b831503a667fb842a34e, UNASSIGN in 187 msec 2023-09-12 19:01:43,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure c28b6a1ef7fc969d64bc83d99f6d6830, server=jenkins-hbase20.apache.org,38579,1694545208565 in 179 msec 2023-09-12 19:01:43,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-12 19:01:43,120 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=c28b6a1ef7fc969d64bc83d99f6d6830, UNASSIGN in 190 msec 2023-09-12 19:01:43,120 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545303120"}]},"ts":"1694545303120"} 2023-09-12 19:01:43,121 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-12 19:01:43,122 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-12 19:01:43,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 262 msec 2023-09-12 19:01:43,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-12 19:01:43,168 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-12 19:01:43,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,174 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,176 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,178 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,181 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,181 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,181 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,181 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,181 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-12 19:01:43,182 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-12 19:01:43,182 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-12 19:01:43,182 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-12 19:01:43,182 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:43,182 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:43,183 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,183 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,183 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:43,183 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:43,183 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,183 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:43,183 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,183 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:43,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-12 19:01:43,185 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/recovered.edits] 2023-09-12 19:01:43,185 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/recovered.edits] 2023-09-12 19:01:43,188 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/cf/aabd3ac69bff4b10b03b0a29166c9867 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/cf/aabd3ac69bff4b10b03b0a29166c9867 2023-09-12 19:01:43,188 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/cf/a5d1a588e004433b9324e0cf8435b50a to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/cf/a5d1a588e004433b9324e0cf8435b50a 2023-09-12 19:01:43,190 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830/recovered.edits/9.seqid 2023-09-12 19:01:43,191 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e/recovered.edits/9.seqid 2023-09-12 19:01:43,191 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/c28b6a1ef7fc969d64bc83d99f6d6830 2023-09-12 19:01:43,191 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testEmptyExportFileSystemState/4ce78189d842b831503a667fb842a34e 2023-09-12 19:01:43,191 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-12 19:01:43,191 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-12 19:01:43,192 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-12 19:01:43,195 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230912148baf561db146b0995e5040f21aae46 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b20230912148baf561db146b0995e5040f21aae46 2023-09-12 19:01:43,196 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230912ba0c5e97e68e4ad7a839d497f51a8f58 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230912ba0c5e97e68e4ad7a839d497f51a8f58 2023-09-12 19:01:43,196 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-12 19:01:43,198 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,201 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-12 19:01:43,203 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-12 19:01:43,204 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,204 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-12 19:01:43,204 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545303204"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:43,204 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545303204"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:43,206 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 19:01:43,206 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4ce78189d842b831503a667fb842a34e, NAME => 'testtb-testEmptyExportFileSystemState,,1694545292689.4ce78189d842b831503a667fb842a34e.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c28b6a1ef7fc969d64bc83d99f6d6830, NAME => 'testtb-testEmptyExportFileSystemState,1,1694545292689.c28b6a1ef7fc969d64bc83d99f6d6830.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 19:01:43,206 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-12 19:01:43,206 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694545303206"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:43,208 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-12 19:01:43,209 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-12 19:01:43,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 39 msec 2023-09-12 19:01:43,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-12 19:01:43,287 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-12 19:01:43,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-12 19:01:43,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:43,301 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-12 19:01:43,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-12 19:01:43,326 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 762) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:37941 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1724615919_1 at /127.0.0.1:38150 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:47942 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4843 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:44131 from appattempt_1694545214673_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:35800 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:44114 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:44573 from appattempt_1694545214673_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=939 (was 914) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=165 (was 134) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=1767 (was 1846) 2023-09-12 19:01:43,327 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-12 19:01:43,348 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=939, MaxFileDescriptor=60000, SystemLoadAverage=165, ProcessCount=167, AvailableMemoryMB=1766 2023-09-12 19:01:43,349 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-12 19:01:43,351 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$4(2112): Client=jenkins//148.251.75.209 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-12 19:01:43,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:43,355 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-12 19:01:43,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(700): Client=jenkins//148.251.75.209 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-12 19:01:43,355 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-12 19:01:43,356 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-12 19:01:43,357 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:43,357 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:43,358 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac empty. 2023-09-12 19:01:43,358 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b empty. 2023-09-12 19:01:43,358 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:43,358 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:43,358 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-12 19:01:43,367 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-12 19:01:43,368 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => ec4a11900a8ec98fe540a3f4fc1797ac, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:01:43,368 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9e63b63553364f452cbb37dc2650c24b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp 2023-09-12 19:01:43,378 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:43,378 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing ec4a11900a8ec98fe540a3f4fc1797ac, disabling compactions & flushes 2023-09-12 19:01:43,378 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:43,378 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:43,378 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. after waiting 0 ms 2023-09-12 19:01:43,378 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:43,378 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:43,378 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for ec4a11900a8ec98fe540a3f4fc1797ac: 2023-09-12 19:01:43,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:43,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 9e63b63553364f452cbb37dc2650c24b, disabling compactions & flushes 2023-09-12 19:01:43,379 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:43,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:43,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. after waiting 0 ms 2023-09-12 19:01:43,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:43,379 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:43,379 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 9e63b63553364f452cbb37dc2650c24b: 2023-09-12 19:01:43,380 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-12 19:01:43,381 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694545303381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545303381"}]},"ts":"1694545303381"} 2023-09-12 19:01:43,381 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694545303381"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545303381"}]},"ts":"1694545303381"} 2023-09-12 19:01:43,383 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-12 19:01:43,384 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-12 19:01:43,384 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545303384"}]},"ts":"1694545303384"} 2023-09-12 19:01:43,385 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-12 19:01:43,387 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase20.apache.org=0} racks are {/default-rack=0} 2023-09-12 19:01:43,388 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-12 19:01:43,388 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-12 19:01:43,388 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-12 19:01:43,388 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-12 19:01:43,388 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec4a11900a8ec98fe540a3f4fc1797ac, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9e63b63553364f452cbb37dc2650c24b, ASSIGN}] 2023-09-12 19:01:43,390 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec4a11900a8ec98fe540a3f4fc1797ac, ASSIGN 2023-09-12 19:01:43,390 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9e63b63553364f452cbb37dc2650c24b, ASSIGN 2023-09-12 19:01:43,391 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec4a11900a8ec98fe540a3f4fc1797ac, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,42275,1694545208517; forceNewPlan=false, retain=false 2023-09-12 19:01:43,391 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9e63b63553364f452cbb37dc2650c24b, ASSIGN; state=OFFLINE, location=jenkins-hbase20.apache.org,36759,1694545208602; forceNewPlan=false, retain=false 2023-09-12 19:01:43,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-12 19:01:43,541 INFO [jenkins-hbase20:38069] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-12 19:01:43,546 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ec4a11900a8ec98fe540a3f4fc1797ac, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:43,546 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9e63b63553364f452cbb37dc2650c24b, regionState=OPENING, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:43,547 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694545303546"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545303546"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545303546"}]},"ts":"1694545303546"} 2023-09-12 19:01:43,547 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694545303546"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545303546"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545303546"}]},"ts":"1694545303546"} 2023-09-12 19:01:43,550 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure ec4a11900a8ec98fe540a3f4fc1797ac, server=jenkins-hbase20.apache.org,42275,1694545208517}] 2023-09-12 19:01:43,551 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure 9e63b63553364f452cbb37dc2650c24b, server=jenkins-hbase20.apache.org,36759,1694545208602}] 2023-09-12 19:01:43,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-12 19:01:43,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:43,705 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:43,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ec4a11900a8ec98fe540a3f4fc1797ac, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.', STARTKEY => '', ENDKEY => '1'} 2023-09-12 19:01:43,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9e63b63553364f452cbb37dc2650c24b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.', STARTKEY => '1', ENDKEY => ''} 2023-09-12 19:01:43,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. service=AccessControlService 2023-09-12 19:01:43,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. service=AccessControlService 2023-09-12 19:01:43,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:01:43,706 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-12 19:01:43,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:43,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:43,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:43,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-12 19:01:43,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:43,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7894): checking encryption for 9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:43,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:43,706 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(7897): checking classloading for 9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:43,707 INFO [StoreOpener-9e63b63553364f452cbb37dc2650c24b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:43,707 INFO [StoreOpener-ec4a11900a8ec98fe540a3f4fc1797ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:43,708 DEBUG [StoreOpener-9e63b63553364f452cbb37dc2650c24b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/cf 2023-09-12 19:01:43,708 DEBUG [StoreOpener-9e63b63553364f452cbb37dc2650c24b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/cf 2023-09-12 19:01:43,708 DEBUG [StoreOpener-ec4a11900a8ec98fe540a3f4fc1797ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/cf 2023-09-12 19:01:43,708 DEBUG [StoreOpener-ec4a11900a8ec98fe540a3f4fc1797ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/cf 2023-09-12 19:01:43,709 INFO [StoreOpener-9e63b63553364f452cbb37dc2650c24b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9e63b63553364f452cbb37dc2650c24b columnFamilyName cf 2023-09-12 19:01:43,709 INFO [StoreOpener-ec4a11900a8ec98fe540a3f4fc1797ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ec4a11900a8ec98fe540a3f4fc1797ac columnFamilyName cf 2023-09-12 19:01:43,710 INFO [StoreOpener-9e63b63553364f452cbb37dc2650c24b-1] regionserver.HStore(310): Store=9e63b63553364f452cbb37dc2650c24b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:01:43,710 INFO [StoreOpener-ec4a11900a8ec98fe540a3f4fc1797ac-1] regionserver.HStore(310): Store=ec4a11900a8ec98fe540a3f4fc1797ac/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-12 19:01:43,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:43,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:43,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:43,712 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:43,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:43,714 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1055): writing seq id for 9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:43,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:01:43,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-12 19:01:43,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened ec4a11900a8ec98fe540a3f4fc1797ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70088588, jitterRate=0.044401347637176514}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:01:43,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for ec4a11900a8ec98fe540a3f4fc1797ac: 2023-09-12 19:01:43,717 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1072): Opened 9e63b63553364f452cbb37dc2650c24b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70661678, jitterRate=0.05294105410575867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-12 19:01:43,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(965): Region open journal for 9e63b63553364f452cbb37dc2650c24b: 2023-09-12 19:01:43,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac., pid=108, masterSystemTime=1694545303703 2023-09-12 19:01:43,718 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b., pid=109, masterSystemTime=1694545303703 2023-09-12 19:01:43,719 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:43,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:43,720 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=ec4a11900a8ec98fe540a3f4fc1797ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:43,720 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:43,720 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase20:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:43,720 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694545303720"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545303720"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545303720"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545303720"}]},"ts":"1694545303720"} 2023-09-12 19:01:43,720 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=9e63b63553364f452cbb37dc2650c24b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:43,721 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694545303720"},{"qualifier":"server","vlen":32,"tag":[],"timestamp":"1694545303720"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1694545303720"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1694545303720"}]},"ts":"1694545303720"} 2023-09-12 19:01:43,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-12 19:01:43,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure ec4a11900a8ec98fe540a3f4fc1797ac, server=jenkins-hbase20.apache.org,42275,1694545208517 in 171 msec 2023-09-12 19:01:43,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-12 19:01:43,724 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure 9e63b63553364f452cbb37dc2650c24b, server=jenkins-hbase20.apache.org,36759,1694545208602 in 171 msec 2023-09-12 19:01:43,724 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec4a11900a8ec98fe540a3f4fc1797ac, ASSIGN in 335 msec 2023-09-12 19:01:43,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-12 19:01:43,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9e63b63553364f452cbb37dc2650c24b, ASSIGN in 336 msec 2023-09-12 19:01:43,726 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-12 19:01:43,726 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545303726"}]},"ts":"1694545303726"} 2023-09-12 19:01:43,727 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-12 19:01:43,728 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-12 19:01:43,729 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-12 19:01:43,730 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-12 19:01:43,731 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:43,731 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:43,731 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:43,731 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:43,732 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:43,732 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:43,732 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:43,732 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-12 19:01:43,733 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 381 msec 2023-09-12 19:01:43,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-12 19:01:43,964 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-12 19:01:43,969 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:43,970 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:43,973 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:01:43,992 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 19:01:43,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545303992 (current time:1694545303992). 2023-09-12 19:01:43,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:01:43,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x5da5a685 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:44,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7471f64c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:44,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:44,006 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:44,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5da5a685 to 127.0.0.1:53172 2023-09-12 19:01:44,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:44,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x27cba39c to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:44,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57aaa86e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:44,014 DEBUG [hconnection-0x2c92f741-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:44,018 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38994, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:44,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:44,029 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36082, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:44,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27cba39c to 127.0.0.1:53172 2023-09-12 19:01:44,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:44,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-12 19:01:44,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:01:44,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 19:01:44,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 19:01:44,034 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 19:01:44,034 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694545904034 2023-09-12 19:01:44,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 19:01:44,034 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,036 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:01:44,036 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:01:44,037 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 19:01:44,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 19:01:44,038 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-12 19:01:44,039 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 19:01:44,039 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694545904039 2023-09-12 19:01:44,053 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,053 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-12 19:01:44,053 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:44,054 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-12 19:01:44,055 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-12 19:01:44,055 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,055 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,062 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,062 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,062 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,062 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,062 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,062 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,062 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,062 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:01:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,063 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-12 19:01:44,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,065 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-12 19:01:44,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,065 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 19:01:44,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 19:01:44,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-12 19:01:44,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,066 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 19:01:44,066 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 19:01:44,066 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:44,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,066 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,067 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 19:01:44,067 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 19:01:44,067 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:44,067 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 19:01:44,068 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 19:01:44,068 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 19:01:44,068 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 19:01:44,068 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 19:01:44,067 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:44,068 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 19:01:44,069 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 19:01:44,069 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 19:01:44,069 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 19:01:44,081 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,081 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,081 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,081 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,081 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:44,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:44,081 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,081 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:44,081 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,082 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:44,082 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,082 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:44,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:44,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:44,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:44,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-12 19:01:44,084 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d1a252d[Count = 1] remaining members to acquire global barrier 2023-09-12 19:01:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:44,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:44,085 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-12 19:01:44,086 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5d1a252d[Count = 0] remaining members to acquire global barrier 2023-09-12 19:01:44,086 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-12 19:01:44,086 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,090 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,090 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,090 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,090 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,090 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 19:01:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,090 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 19:01:44,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,090 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:01:44,090 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 19:01:44,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,090 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,090 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:01:44,090 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 19:01:44,090 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:44,090 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:44,090 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:44,090 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:44,090 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:44,090 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. started... 2023-09-12 19:01:44,090 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:44,091 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. started... 2023-09-12 19:01:44,092 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec4a11900a8ec98fe540a3f4fc1797ac: 2023-09-12 19:01:44,092 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e63b63553364f452cbb37dc2650c24b: 2023-09-12 19:01:44,092 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 19:01:44,092 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,092 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,092 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:44,092 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:44,093 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:01:44,093 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:44,093 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 19:01:44,094 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-12 19:01:44,112 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. completed. 2023-09-12 19:01:44,112 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:44,112 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:44,112 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:44,112 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,112 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 19:01:44,112 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:01:44,117 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. completed. 2023-09-12 19:01:44,117 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:44,117 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:44,117 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:44,117 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,117 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 19:01:44,117 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:01:44,123 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 19:01:44,123 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:44,123 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 19:01:44,123 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:44,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:44,125 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,125 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 19:01:44,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:44,125 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:44,125 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 19:01:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:44,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:44,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,36759,1694545208602': 2023-09-12 19:01:44,129 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-12 19:01:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:44,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,42275,1694545208517': 2023-09-12 19:01:44,131 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-12 19:01:44,131 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-12 19:01:44,132 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:01:44,132 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:01:44,132 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,132 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:01:44,136 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:44,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-12 19:01:44,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:01:44,137 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:01:44,139 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,139 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,139 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:44,139 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,139 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,139 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,140 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:44,140 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,140 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,140 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,140 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,141 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,143 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,143 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,143 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,148 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,148 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,148 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,148 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,148 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:44,148 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,148 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,148 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,148 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,148 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,150 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,150 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,148 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,150 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:01:44,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,150 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,150 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,150 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,151 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,151 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,151 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,151 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,151 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-12 19:01:44,151 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,181 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-12 19:01:44,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,181 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694545304035Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694545304161 (+126 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694545304161Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694545304161Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694545304164 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1694545304175 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694545304181 (+6 ms) 2023-09-12 19:01:44,184 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 19:01:44,186 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 148 msec 2023-09-12 19:01:44,338 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:44,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-12 19:01:44,339 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:01:44,342 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42275] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:01:44,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36759] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-12 19:01:44,348 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,348 DEBUG [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:44,348 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-12 19:01:44,359 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1583): Client=jenkins//148.251.75.209 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 19:01:44,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1694545304359 (current time:1694545304359). 2023-09-12 19:01:44,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-12 19:01:44,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x7ba2abca to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:44,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40b16300, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:44,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:44,371 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:38998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:44,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7ba2abca to 127.0.0.1:53172 2023-09-12 19:01:44,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:44,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(139): Connect 0x56afe3c6 to 127.0.0.1:53172 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-12 19:01:44,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@38bdee22, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-12 19:01:44,384 DEBUG [hconnection-0x735f3356-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:44,385 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:39010, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:44,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-12 19:01:44,393 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 148.251.75.209:36092, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-12 19:01:44,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x56afe3c6 to 127.0.0.1:53172 2023-09-12 19:01:44,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:01:44,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-12 19:01:44,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-12 19:01:44,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 19:01:44,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 19:01:44,398 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 19:01:44,398 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1694545904398 2023-09-12 19:01:44,398 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-12 19:01:44,400 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-12 19:01:44,401 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-12 19:01:44,401 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-12 19:01:44,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 19:01:44,401 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 5 msec 2023-09-12 19:01:44,402 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 19:01:44,403 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1694545904403 2023-09-12 19:01:44,412 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,412 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-12 19:01:44,412 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:44,413 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-12 19:01:44,413 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-12 19:01:44,414 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,414 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,414 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,414 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,414 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,415 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,415 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,415 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,415 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,415 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,415 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-12 19:01:44,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,415 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-12 19:01:44,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-12 19:01:44,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,416 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 19:01:44,416 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 19:01:44,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,416 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 19:01:44,416 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 19:01:44,416 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:44,416 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:44,417 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 19:01:44,417 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,418 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 19:01:44,418 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 19:01:44,417 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 19:01:44,418 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 19:01:44,418 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 19:01:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-12 19:01:44,418 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,418 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-12 19:01:44,418 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,418 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-12 19:01:44,418 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-12 19:01:44,419 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-12 19:01:44,419 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-12 19:01:44,419 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase20.apache.org,38579,1694545208565' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-12 19:01:44,420 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,420 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:44,420 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,420 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:44,420 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,420 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:44,421 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:44,421 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,421 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:44,421 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,421 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-12 19:01:44,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:44,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,42275,1694545208517' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-12 19:01:44,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@582a184a[Count = 1] remaining members to acquire global barrier 2023-09-12 19:01:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:44,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,424 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:44,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase20.apache.org,36759,1694545208602' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-12 19:01:44,424 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@582a184a[Count = 0] remaining members to acquire global barrier 2023-09-12 19:01:44,424 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-12 19:01:44,424 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,425 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,425 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,425 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 19:01:44,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,425 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 19:01:44,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,425 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-12 19:01:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-12 19:01:44,425 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,425 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-12 19:01:44,425 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-12 19:01:44,426 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 19:01:44,425 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:44,425 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. started... 2023-09-12 19:01:44,426 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. started... 2023-09-12 19:01:44,426 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,38579,1694545208565' in zk 2023-09-12 19:01:44,426 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ec4a11900a8ec98fe540a3f4fc1797ac 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-12 19:01:44,426 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9e63b63553364f452cbb37dc2650c24b 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-12 19:01:44,426 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 19:01:44,426 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:44,426 DEBUG [member: 'jenkins-hbase20.apache.org,38579,1694545208565' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 19:01:44,442 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230912b4dda713957c4eddbd3aa2403d6c0787 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230912b4dda713957c4eddbd3aa2403d6c0787 2023-09-12 19:01:44,442 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023091275cc2542a5ab43c386cf01ab07719f6d to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023091275cc2542a5ab43c386cf01ab07719f6d 2023-09-12 19:01:44,460 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/.tmp/cf/c62b0c40976e48f498b3094f213c63fe 2023-09-12 19:01:44,460 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/.tmp/cf/bcd1d59ae7884f2ba92fd96a4e3d9eda 2023-09-12 19:01:44,464 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/.tmp/cf/c62b0c40976e48f498b3094f213c63fe as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/cf/c62b0c40976e48f498b3094f213c63fe 2023-09-12 19:01:44,464 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/.tmp/cf/bcd1d59ae7884f2ba92fd96a4e3d9eda as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/cf/bcd1d59ae7884f2ba92fd96a4e3d9eda 2023-09-12 19:01:44,468 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/cf/c62b0c40976e48f498b3094f213c63fe, entries=3, sequenceid=6, filesize=5.4 K 2023-09-12 19:01:44,468 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/cf/bcd1d59ae7884f2ba92fd96a4e3d9eda, entries=47, sequenceid=6, filesize=13.3 K 2023-09-12 19:01:44,469 INFO [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 9e63b63553364f452cbb37dc2650c24b in 43ms, sequenceid=6, compaction requested=false 2023-09-12 19:01:44,469 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-12 19:01:44,469 INFO [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for ec4a11900a8ec98fe540a3f4fc1797ac in 43ms, sequenceid=6, compaction requested=false 2023-09-12 19:01:44,469 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-12 19:01:44,472 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9e63b63553364f452cbb37dc2650c24b: 2023-09-12 19:01:44,472 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ec4a11900a8ec98fe540a3f4fc1797ac: 2023-09-12 19:01:44,472 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,472 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,472 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:44,472 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-12 19:01:44,472 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/cf/bcd1d59ae7884f2ba92fd96a4e3d9eda] hfiles 2023-09-12 19:01:44,472 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/cf/bcd1d59ae7884f2ba92fd96a4e3d9eda for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,472 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/cf/c62b0c40976e48f498b3094f213c63fe] hfiles 2023-09-12 19:01:44,472 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/cf/c62b0c40976e48f498b3094f213c63fe for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,482 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. completed. 2023-09-12 19:01:44,482 DEBUG [rs(jenkins-hbase20.apache.org,36759,1694545208602)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:44,482 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:44,483 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:44,483 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,483 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 19:01:44,483 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,36759,1694545208602' in zk 2023-09-12 19:01:44,483 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. completed. 2023-09-12 19:01:44,483 DEBUG [rs(jenkins-hbase20.apache.org,42275,1694545208517)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:44,484 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-12 19:01:44,484 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-12 19:01:44,484 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,484 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-12 19:01:44,484 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase20.apache.org,42275,1694545208517' in zk 2023-09-12 19:01:44,484 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,484 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 19:01:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:44,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:44,484 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:44,484 DEBUG [member: 'jenkins-hbase20.apache.org,36759,1694545208602' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 19:01:44,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:44,486 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,486 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-12 19:01:44,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:44,486 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:44,486 DEBUG [member: 'jenkins-hbase20.apache.org,42275,1694545208517' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-12 19:01:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:44,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,36759,1694545208602': 2023-09-12 19:01:44,490 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,36759,1694545208602' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-12 19:01:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:44,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase20.apache.org,42275,1694545208517': 2023-09-12 19:01:44,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase20.apache.org,42275,1694545208517' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-12 19:01:44,492 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-12 19:01:44,492 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-12 19:01:44,492 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-12 19:01:44,492 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,492 INFO [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-12 19:01:44,499 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,499 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,499 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,499 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,499 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,499 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,500 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-12 19:01:44,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-12 19:01:44,499 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,500 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-12 19:01:44,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,501 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:44,501 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-12 19:01:44,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-12 19:01:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-12 19:01:44,502 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-12 19:01:44,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,503 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,504 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-12 19:01:44,504 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,507 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,508 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,508 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,508 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,508 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,508 DEBUG [(jenkins-hbase20.apache.org,38069,1694545207479)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-12 19:01:44,508 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,508 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,508 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-12 19:01:44,510 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,508 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-12 19:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-12 19:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-12 19:01:44,510 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,510 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,510 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,510 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:44,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,510 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,510 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-12 19:01:44,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-12 19:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,511 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:01:44,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-12 19:01:44,511 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:44,511 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,511 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023091275cc2542a5ab43c386cf01ab07719f6d, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230912b4dda713957c4eddbd3aa2403d6c0787] mob files 2023-09-12 19:01:44,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023091275cc2542a5ab43c386cf01ab07719f6d 2023-09-12 19:01:44,512 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230912b4dda713957c4eddbd3aa2403d6c0787 2023-09-12 19:01:44,519 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,520 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,539 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,540 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-12 19:01:44,540 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,540 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,541 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase20:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1694545304398Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1694545304519 (+121 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694545304519Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1694545304519Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1694545304522 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1694545304531 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1694545304540 (+9 ms) 2023-09-12 19:01:44,543 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-12 19:01:44,545 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 144 msec 2023-09-12 19:01:44,702 DEBUG [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-12 19:01:44,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-12 19:01:44,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-12 19:01:44,705 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545304705 2023-09-12 19:01:44,705 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:36845, tgtDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545304705, rawTgtDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545304705, srcFsUri=hdfs://localhost:36845, srcDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:01:44,729 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0 2023-09-12 19:01:44,729 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1895733595_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545304705, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545304705/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,729 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:36845, inputRoot=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0, snapshotDir=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-12 19:01:44,740 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545304705/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:44,762 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:44,762 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:44,763 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:44,763 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:45,462 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-9211746173479569935.jar 2023-09-12 19:01:45,462 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:45,463 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:45,516 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/hadoop-5074222973690441576.jar 2023-09-12 19:01:45,516 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:45,516 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:45,517 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:45,517 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:45,517 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:45,518 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-12 19:01:45,518 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-12 19:01:45,518 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-12 19:01:45,519 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-12 19:01:45,519 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-12 19:01:45,519 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-12 19:01:45,520 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-12 19:01:45,520 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-12 19:01:45,520 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-12 19:01:45,520 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-12 19:01:45,521 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-12 19:01:45,521 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:45,521 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:45,522 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:45,522 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:45,522 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-12 19:01:45,523 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:45,523 DEBUG [Listener at jenkins-hbase20.apache.org/37289] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-12 19:01:45,858 WARN [Listener at jenkins-hbase20.apache.org/37289] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-12 19:01:45,859 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-12 19:01:45,861 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-12 19:01:47,578 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:01:47,578 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-12 19:01:47,580 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0006_000001 (auth:SIMPLE) 2023-09-12 19:01:48,416 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0007_000001 (auth:SIMPLE) 2023-09-12 19:01:48,681 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 19:01:51,773 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0007_000001 (auth:SIMPLE) 2023-09-12 19:01:53,970 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0007_000001 (auth:SIMPLE) 2023-09-12 19:01:56,074 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0007_000001 (auth:SIMPLE) 2023-09-12 19:01:57,239 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-12 19:01:57,239 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-12 19:01:57,249 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,249 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-12 19:01:57,250 INFO [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-12 19:01:57,250 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,250 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-12 19:01:57,250 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-12 19:01:57,250 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1131671206_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545304705/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545304705/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,251 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545304705/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-12 19:01:57,251 DEBUG [Listener at jenkins-hbase20.apache.org/37289] snapshot.TestExportSnapshot(367): hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/export-test/export-1694545304705/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-12 19:01:57,256 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$11(2418): Client=jenkins//148.251.75.209 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-12 19:01:57,259 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545317259"}]},"ts":"1694545317259"} 2023-09-12 19:01:57,260 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-12 19:01:57,261 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-12 19:01:57,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec4a11900a8ec98fe540a3f4fc1797ac, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9e63b63553364f452cbb37dc2650c24b, UNASSIGN}] 2023-09-12 19:01:57,263 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec4a11900a8ec98fe540a3f4fc1797ac, UNASSIGN 2023-09-12 19:01:57,263 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9e63b63553364f452cbb37dc2650c24b, UNASSIGN 2023-09-12 19:01:57,264 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ec4a11900a8ec98fe540a3f4fc1797ac, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:01:57,264 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9e63b63553364f452cbb37dc2650c24b, regionState=CLOSING, regionLocation=jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:01:57,264 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694545317264"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545317264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545317264"}]},"ts":"1694545317264"} 2023-09-12 19:01:57,264 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694545317264"},{"qualifier":"sn","vlen":46,"tag":[],"timestamp":"1694545317264"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1694545317264"}]},"ts":"1694545317264"} 2023-09-12 19:01:57,266 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure ec4a11900a8ec98fe540a3f4fc1797ac, server=jenkins-hbase20.apache.org,42275,1694545208517}] 2023-09-12 19:01:57,266 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 9e63b63553364f452cbb37dc2650c24b, server=jenkins-hbase20.apache.org,36759,1694545208602}] 2023-09-12 19:01:57,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-12 19:01:57,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close 9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:57,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(111): Close ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:57,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 9e63b63553364f452cbb37dc2650c24b, disabling compactions & flushes 2023-09-12 19:01:57,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:57,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:57,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. after waiting 0 ms 2023-09-12 19:01:57,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:57,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing ec4a11900a8ec98fe540a3f4fc1797ac, disabling compactions & flushes 2023-09-12 19:01:57,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:57,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:57,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. after waiting 0 ms 2023-09-12 19:01:57,419 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:57,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:01:57,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:01:57,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:57,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:01:57,440 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac. 2023-09-12 19:01:57,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for ec4a11900a8ec98fe540a3f4fc1797ac: 2023-09-12 19:01:57,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b. 2023-09-12 19:01:57,441 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 9e63b63553364f452cbb37dc2650c24b: 2023-09-12 19:01:57,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed 9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:57,443 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=9e63b63553364f452cbb37dc2650c24b, regionState=CLOSED 2023-09-12 19:01:57,443 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694545317443"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545317443"}]},"ts":"1694545317443"} 2023-09-12 19:01:57,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.UnassignRegionHandler(149): Closed ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:57,444 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=ec4a11900a8ec98fe540a3f4fc1797ac, regionState=CLOSED 2023-09-12 19:01:57,444 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1694545317444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1694545317444"}]},"ts":"1694545317444"} 2023-09-12 19:01:57,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-12 19:01:57,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 9e63b63553364f452cbb37dc2650c24b, server=jenkins-hbase20.apache.org,36759,1694545208602 in 178 msec 2023-09-12 19:01:57,449 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-12 19:01:57,449 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=9e63b63553364f452cbb37dc2650c24b, UNASSIGN in 185 msec 2023-09-12 19:01:57,449 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure ec4a11900a8ec98fe540a3f4fc1797ac, server=jenkins-hbase20.apache.org,42275,1694545208517 in 179 msec 2023-09-12 19:01:57,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=115, resume processing ppid=114 2023-09-12 19:01:57,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=ec4a11900a8ec98fe540a3f4fc1797ac, UNASSIGN in 188 msec 2023-09-12 19:01:57,451 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1694545317451"}]},"ts":"1694545317451"} 2023-09-12 19:01:57,452 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-12 19:01:57,453 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-12 19:01:57,454 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 197 msec 2023-09-12 19:01:57,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-12 19:01:57,564 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-12 19:01:57,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.HMaster$5(2228): Client=jenkins//148.251.75.209 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,572 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,574 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,576 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38579] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,579 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,579 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,579 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,579 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-12 19:01:57,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-12 19:01:57,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-12 19:01:57,580 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-12 19:01:57,581 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,581 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,581 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,581 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:57,581 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,581 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:57,581 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:57,581 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-12 19:01:57,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-12 19:01:57,582 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:57,582 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:57,584 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/recovered.edits] 2023-09-12 19:01:57,584 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/cf, FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/recovered.edits] 2023-09-12 19:01:57,588 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/cf/bcd1d59ae7884f2ba92fd96a4e3d9eda to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/cf/bcd1d59ae7884f2ba92fd96a4e3d9eda 2023-09-12 19:01:57,588 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/cf/c62b0c40976e48f498b3094f213c63fe to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/cf/c62b0c40976e48f498b3094f213c63fe 2023-09-12 19:01:57,591 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b/recovered.edits/9.seqid 2023-09-12 19:01:57,591 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/recovered.edits/9.seqid to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac/recovered.edits/9.seqid 2023-09-12 19:01:57,591 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/9e63b63553364f452cbb37dc2650c24b 2023-09-12 19:01:57,591 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/ec4a11900a8ec98fe540a3f4fc1797ac 2023-09-12 19:01:57,591 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-12 19:01:57,592 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-12 19:01:57,592 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-12 19:01:57,594 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023091275cc2542a5ab43c386cf01ab07719f6d to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b2023091275cc2542a5ab43c386cf01ab07719f6d 2023-09-12 19:01:57,595 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230912b4dda713957c4eddbd3aa2403d6c0787 to hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e20230912b4dda713957c4eddbd3aa2403d6c0787 2023-09-12 19:01:57,595 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-12 19:01:57,596 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,598 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-12 19:01:57,600 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-12 19:01:57,601 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,601 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-12 19:01:57,601 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545317601"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:57,601 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1694545317601"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:57,603 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-12 19:01:57,603 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ec4a11900a8ec98fe540a3f4fc1797ac, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1694545303350.ec4a11900a8ec98fe540a3f4fc1797ac.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9e63b63553364f452cbb37dc2650c24b, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1694545303350.9e63b63553364f452cbb37dc2650c24b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-12 19:01:57,603 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-12 19:01:57,603 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1694545317603"}]},"ts":"9223372036854775807"} 2023-09-12 19:01:57,604 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-12 19:01:57,606 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 40 msec 2023-09-12 19:01:57,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-12 19:01:57,684 INFO [Listener at jenkins-hbase20.apache.org/37289] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-12 19:01:57,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-12 19:01:57,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,703 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] master.MasterRpcServices(751): Client=jenkins//148.251.75.209 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-12 19:01:57,704 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38069] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-12 19:01:57,731 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 764) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:47026 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1725433360_1 at /127.0.0.1:33472 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:44573 from appattempt_1694545214673_0007_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5450 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:33506 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x2aed008f-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1709906976) connection to jenkins-hbase20.apache.org/148.251.75.209:32983 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1131671206_17 at /127.0.0.1:45698 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=912 (was 939), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=139 (was 165), ProcessCount=167 (was 167), AvailableMemoryMB=1699 (was 1766) 2023-09-12 19:01:57,731 WARN [Listener at jenkins-hbase20.apache.org/37289] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-12 19:01:57,731 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-12 19:01:57,746 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-12 19:02:02,310 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1694545214673_0007_000001 (auth:SIMPLE) 2023-09-12 19:02:03,011 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-12 19:02:11,892 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-12 19:02:26,029 ERROR [Thread[Thread-409,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-12 19:02:26,029 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-12 19:02:26,146 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-12 19:02:26,155 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-12 19:02:26,156 ERROR [Thread[Thread-419,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-12 19:02:26,168 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase20.apache.org:0 2023-09-12 19:02:26,273 ERROR [Thread[Thread-384,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-12 19:02:26,273 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-12 19:02:26,273 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-12 19:02:26,273 INFO [Listener at jenkins-hbase20.apache.org/37289] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-12 19:02:26,273 DEBUG [Listener at jenkins-hbase20.apache.org/37289] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50cb261a to 127.0.0.1:53172 2023-09-12 19:02:26,274 DEBUG [Listener at jenkins-hbase20.apache.org/37289] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:02:26,274 DEBUG [Listener at jenkins-hbase20.apache.org/37289] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-12 19:02:26,274 DEBUG [Listener at jenkins-hbase20.apache.org/37289] util.JVMClusterUtil(257): Found active master hash=874924430, stopped=false 2023-09-12 19:02:26,275 DEBUG [Listener at jenkins-hbase20.apache.org/37289] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:02:26,275 DEBUG [Listener at jenkins-hbase20.apache.org/37289] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-12 19:02:26,275 INFO [Listener at jenkins-hbase20.apache.org/37289] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase20.apache.org,38069,1694545207479 2023-09-12 19:02:26,277 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-12 19:02:26,277 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-12 19:02:26,277 INFO [Listener at jenkins-hbase20.apache.org/37289] procedure2.ProcedureExecutor(628): Stopping 2023-09-12 19:02:26,277 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-12 19:02:26,277 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-12 19:02:26,278 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:02:26,278 DEBUG [Listener at jenkins-hbase20.apache.org/37289] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6c39a083 to 127.0.0.1:53172 2023-09-12 19:02:26,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 19:02:26,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 19:02:26,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 19:02:26,278 DEBUG [Listener at jenkins-hbase20.apache.org/37289] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:02:26,278 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-12 19:02:26,278 INFO [Listener at jenkins-hbase20.apache.org/37289] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,42275,1694545208517' ***** 2023-09-12 19:02:26,279 DEBUG [Listener at jenkins-hbase20.apache.org/37289] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:02:26,279 INFO [Listener at jenkins-hbase20.apache.org/37289] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-12 19:02:26,279 INFO [Listener at jenkins-hbase20.apache.org/37289] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38579,1694545208565' ***** 2023-09-12 19:02:26,279 DEBUG [Listener at jenkins-hbase20.apache.org/37289] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:02:26,279 INFO [RS:0;jenkins-hbase20:42275] regionserver.HeapMemoryManager(220): Stopping 2023-09-12 19:02:26,279 INFO [Listener at jenkins-hbase20.apache.org/37289] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-12 19:02:26,279 INFO [Listener at jenkins-hbase20.apache.org/37289] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,36759,1694545208602' ***** 2023-09-12 19:02:26,279 INFO [RS:1;jenkins-hbase20:38579] regionserver.HeapMemoryManager(220): Stopping 2023-09-12 19:02:26,279 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-12 19:02:26,279 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-12 19:02:26,279 INFO [RS:0;jenkins-hbase20:42275] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-12 19:02:26,279 INFO [RS:1;jenkins-hbase20:38579] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-12 19:02:26,280 INFO [RS:0;jenkins-hbase20:42275] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-12 19:02:26,279 DEBUG [Listener at jenkins-hbase20.apache.org/37289] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:02:26,280 INFO [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:02:26,280 INFO [RS:1;jenkins-hbase20:38579] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-12 19:02:26,280 DEBUG [RS:0;jenkins-hbase20:42275] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3b71ae1a to 127.0.0.1:53172 2023-09-12 19:02:26,280 INFO [Listener at jenkins-hbase20.apache.org/37289] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-12 19:02:26,280 INFO [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(3305): Received CLOSE for 28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:02:26,280 DEBUG [RS:0;jenkins-hbase20:42275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:02:26,280 INFO [RS:2;jenkins-hbase20:36759] regionserver.HeapMemoryManager(220): Stopping 2023-09-12 19:02:26,283 INFO [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,42275,1694545208517; all regions closed. 2023-09-12 19:02:26,283 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-12 19:02:26,283 INFO [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:02:26,283 INFO [RS:2;jenkins-hbase20:36759] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-12 19:02:26,283 DEBUG [RS:1;jenkins-hbase20:38579] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7906552c to 127.0.0.1:53172 2023-09-12 19:02:26,283 INFO [RS:2;jenkins-hbase20:36759] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-12 19:02:26,283 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 28744e05aa0ec1711fa3194b8c97dcea, disabling compactions & flushes 2023-09-12 19:02:26,284 INFO [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(3305): Received CLOSE for e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:02:26,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:02:26,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:02:26,283 DEBUG [RS:1;jenkins-hbase20:38579] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:02:26,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing e250f039a5cf7dd4c858fc6f38beccf6, disabling compactions & flushes 2023-09-12 19:02:26,284 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. after waiting 0 ms 2023-09-12 19:02:26,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:02:26,284 INFO [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:02:26,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:02:26,285 INFO [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-12 19:02:26,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:02:26,285 DEBUG [RS:2;jenkins-hbase20:36759] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x67b9810f to 127.0.0.1:53172 2023-09-12 19:02:26,285 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 28744e05aa0ec1711fa3194b8c97dcea 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-12 19:02:26,285 DEBUG [RS:2;jenkins-hbase20:36759] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:02:26,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. after waiting 0 ms 2023-09-12 19:02:26,286 INFO [RS:2;jenkins-hbase20:36759] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-12 19:02:26,285 DEBUG [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1478): Online Regions={28744e05aa0ec1711fa3194b8c97dcea=hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea.} 2023-09-12 19:02:26,286 INFO [RS:2;jenkins-hbase20:36759] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-12 19:02:26,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:02:26,286 INFO [RS:2;jenkins-hbase20:36759] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-12 19:02:26,286 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing e250f039a5cf7dd4c858fc6f38beccf6 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-12 19:02:26,286 INFO [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-12 19:02:26,286 INFO [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-12 19:02:26,287 DEBUG [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740, e250f039a5cf7dd4c858fc6f38beccf6=hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6.} 2023-09-12 19:02:26,287 DEBUG [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1504): Waiting on 28744e05aa0ec1711fa3194b8c97dcea 2023-09-12 19:02:26,287 DEBUG [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1504): Waiting on 1588230740, e250f039a5cf7dd4c858fc6f38beccf6 2023-09-12 19:02:26,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-12 19:02:26,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-12 19:02:26,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-12 19:02:26,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-12 19:02:26,288 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-12 19:02:26,288 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.97 KB heapSize=71.98 KB 2023-09-12 19:02:26,302 DEBUG [RS:0;jenkins-hbase20:42275] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/oldWALs 2023-09-12 19:02:26,302 INFO [RS:0;jenkins-hbase20:42275] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C42275%2C1694545208517:(num 1694545210135) 2023-09-12 19:02:26,302 DEBUG [RS:0;jenkins-hbase20:42275] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:02:26,302 INFO [RS:0;jenkins-hbase20:42275] regionserver.LeaseManager(133): Closed leases 2023-09-12 19:02:26,303 INFO [RS:0;jenkins-hbase20:42275] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-12 19:02:26,303 INFO [RS:0;jenkins-hbase20:42275] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-12 19:02:26,303 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-12 19:02:26,303 INFO [RS:0;jenkins-hbase20:42275] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-12 19:02:26,303 INFO [RS:0;jenkins-hbase20:42275] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-12 19:02:26,305 INFO [RS:0;jenkins-hbase20:42275] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:42275 2023-09-12 19:02:26,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6/.tmp/info/7d6bee96799e4213a6a52d56ddcf5b62 2023-09-12 19:02:26,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea/.tmp/l/007f8c34a51a4b15b66cb0591992b8cd 2023-09-12 19:02:26,321 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-12 19:02:26,321 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-12 19:02:26,321 INFO [regionserver/jenkins-hbase20:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-12 19:02:26,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6/.tmp/info/7d6bee96799e4213a6a52d56ddcf5b62 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6/info/7d6bee96799e4213a6a52d56ddcf5b62 2023-09-12 19:02:26,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 007f8c34a51a4b15b66cb0591992b8cd 2023-09-12 19:02:26,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea/.tmp/l/007f8c34a51a4b15b66cb0591992b8cd as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea/l/007f8c34a51a4b15b66cb0591992b8cd 2023-09-12 19:02:26,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6/info/7d6bee96799e4213a6a52d56ddcf5b62, entries=2, sequenceid=6, filesize=4.8 K 2023-09-12 19:02:26,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for e250f039a5cf7dd4c858fc6f38beccf6 in 43ms, sequenceid=6, compaction requested=false 2023-09-12 19:02:26,330 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/.tmp/info/65c47c21cad240e3877a2b408f3c606f 2023-09-12 19:02:26,331 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:02:26,331 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 19:02:26,331 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:02:26,331 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 19:02:26,331 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,42275,1694545208517 2023-09-12 19:02:26,331 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 19:02:26,331 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 19:02:26,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 007f8c34a51a4b15b66cb0591992b8cd 2023-09-12 19:02:26,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea/l/007f8c34a51a4b15b66cb0591992b8cd, entries=7, sequenceid=18, filesize=5.2 K 2023-09-12 19:02:26,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 28744e05aa0ec1711fa3194b8c97dcea in 49ms, sequenceid=18, compaction requested=false 2023-09-12 19:02:26,336 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,42275,1694545208517] 2023-09-12 19:02:26,338 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65c47c21cad240e3877a2b408f3c606f 2023-09-12 19:02:26,339 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,42275,1694545208517; numProcessing=1 2023-09-12 19:02:26,342 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,42275,1694545208517 already deleted, retry=false 2023-09-12 19:02:26,342 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,42275,1694545208517 expired; onlineServers=2 2023-09-12 19:02:26,344 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/acl/28744e05aa0ec1711fa3194b8c97dcea/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-12 19:02:26,345 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:02:26,346 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:02:26,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 28744e05aa0ec1711fa3194b8c97dcea: 2023-09-12 19:02:26,346 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1694545211325.28744e05aa0ec1711fa3194b8c97dcea. 2023-09-12 19:02:26,350 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/namespace/e250f039a5cf7dd4c858fc6f38beccf6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-12 19:02:26,351 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:02:26,356 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:02:26,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for e250f039a5cf7dd4c858fc6f38beccf6: 2023-09-12 19:02:26,356 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1694545210600.e250f039a5cf7dd4c858fc6f38beccf6. 2023-09-12 19:02:26,363 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/.tmp/rep_barrier/1f44b04fac284c669519b2b683ac1df3 2023-09-12 19:02:26,367 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f44b04fac284c669519b2b683ac1df3 2023-09-12 19:02:26,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/.tmp/table/70970d9008e3461aa19ea4e01037ed57 2023-09-12 19:02:26,382 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70970d9008e3461aa19ea4e01037ed57 2023-09-12 19:02:26,383 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/.tmp/info/65c47c21cad240e3877a2b408f3c606f as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/info/65c47c21cad240e3877a2b408f3c606f 2023-09-12 19:02:26,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65c47c21cad240e3877a2b408f3c606f 2023-09-12 19:02:26,387 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/info/65c47c21cad240e3877a2b408f3c606f, entries=48, sequenceid=131, filesize=10.3 K 2023-09-12 19:02:26,388 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/.tmp/rep_barrier/1f44b04fac284c669519b2b683ac1df3 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/rep_barrier/1f44b04fac284c669519b2b683ac1df3 2023-09-12 19:02:26,391 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1f44b04fac284c669519b2b683ac1df3 2023-09-12 19:02:26,392 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/rep_barrier/1f44b04fac284c669519b2b683ac1df3, entries=13, sequenceid=131, filesize=6.4 K 2023-09-12 19:02:26,392 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/.tmp/table/70970d9008e3461aa19ea4e01037ed57 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/table/70970d9008e3461aa19ea4e01037ed57 2023-09-12 19:02:26,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 70970d9008e3461aa19ea4e01037ed57 2023-09-12 19:02:26,396 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/table/70970d9008e3461aa19ea4e01037ed57, entries=24, sequenceid=131, filesize=6.9 K 2023-09-12 19:02:26,397 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.97 KB/47078, heapSize ~71.93 KB/73656, currentSize=0 B/0 for 1588230740 in 109ms, sequenceid=131, compaction requested=false 2023-09-12 19:02:26,405 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-12 19:02:26,405 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-12 19:02:26,405 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-12 19:02:26,406 INFO [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-12 19:02:26,406 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-12 19:02:26,406 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase20:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-12 19:02:26,442 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 19:02:26,442 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:42275-0x1008d06ae340001, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 19:02:26,442 INFO [RS:0;jenkins-hbase20:42275] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,42275,1694545208517; zookeeper connection closed. 2023-09-12 19:02:26,443 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@68f098b8] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@68f098b8 2023-09-12 19:02:26,487 INFO [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38579,1694545208565; all regions closed. 2023-09-12 19:02:26,487 INFO [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,36759,1694545208602; all regions closed. 2023-09-12 19:02:26,493 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/WALs/jenkins-hbase20.apache.org,36759,1694545208602/jenkins-hbase20.apache.org%2C36759%2C1694545208602.meta.1694545210340.meta not finished, retry = 0 2023-09-12 19:02:26,495 DEBUG [RS:1;jenkins-hbase20:38579] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/oldWALs 2023-09-12 19:02:26,495 INFO [RS:1;jenkins-hbase20:38579] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C38579%2C1694545208565:(num 1694545210136) 2023-09-12 19:02:26,495 DEBUG [RS:1;jenkins-hbase20:38579] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:02:26,495 INFO [RS:1;jenkins-hbase20:38579] regionserver.LeaseManager(133): Closed leases 2023-09-12 19:02:26,495 INFO [RS:1;jenkins-hbase20:38579] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-12 19:02:26,496 INFO [RS:1;jenkins-hbase20:38579] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-12 19:02:26,496 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-12 19:02:26,496 INFO [RS:1;jenkins-hbase20:38579] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-12 19:02:26,496 INFO [RS:1;jenkins-hbase20:38579] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-12 19:02:26,497 INFO [RS:1;jenkins-hbase20:38579] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38579 2023-09-12 19:02:26,498 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 19:02:26,498 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:02:26,498 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,38579,1694545208565 2023-09-12 19:02:26,499 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,38579,1694545208565] 2023-09-12 19:02:26,499 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,38579,1694545208565; numProcessing=2 2023-09-12 19:02:26,499 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,38579,1694545208565 already deleted, retry=false 2023-09-12 19:02:26,499 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,38579,1694545208565 expired; onlineServers=1 2023-09-12 19:02:26,597 DEBUG [RS:2;jenkins-hbase20:36759] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/oldWALs 2023-09-12 19:02:26,597 INFO [RS:2;jenkins-hbase20:36759] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36759%2C1694545208602.meta:.meta(num 1694545210340) 2023-09-12 19:02:26,600 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 19:02:26,600 INFO [RS:1;jenkins-hbase20:38579] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38579,1694545208565; zookeeper connection closed. 2023-09-12 19:02:26,601 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:38579-0x1008d06ae340002, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 19:02:26,601 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2434ab1b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2434ab1b 2023-09-12 19:02:26,605 DEBUG [RS:2;jenkins-hbase20:36759] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/oldWALs 2023-09-12 19:02:26,605 INFO [RS:2;jenkins-hbase20:36759] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase20.apache.org%2C36759%2C1694545208602:(num 1694545210135) 2023-09-12 19:02:26,605 DEBUG [RS:2;jenkins-hbase20:36759] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:02:26,605 INFO [RS:2;jenkins-hbase20:36759] regionserver.LeaseManager(133): Closed leases 2023-09-12 19:02:26,605 INFO [RS:2;jenkins-hbase20:36759] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase20:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-12 19:02:26,605 INFO [regionserver/jenkins-hbase20:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-12 19:02:26,606 INFO [RS:2;jenkins-hbase20:36759] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:36759 2023-09-12 19:02:26,607 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase20.apache.org,36759,1694545208602 2023-09-12 19:02:26,607 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-12 19:02:26,608 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase20.apache.org,36759,1694545208602] 2023-09-12 19:02:26,609 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase20.apache.org,36759,1694545208602; numProcessing=3 2023-09-12 19:02:26,609 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase20.apache.org,36759,1694545208602 already deleted, retry=false 2023-09-12 19:02:26,609 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase20.apache.org,36759,1694545208602 expired; onlineServers=0 2023-09-12 19:02:26,609 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase20.apache.org,38069,1694545207479' ***** 2023-09-12 19:02:26,609 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-12 19:02:26,609 DEBUG [M:0;jenkins-hbase20:38069] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@751b43b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase20.apache.org/148.251.75.209:0 2023-09-12 19:02:26,610 INFO [M:0;jenkins-hbase20:38069] regionserver.HRegionServer(1144): stopping server jenkins-hbase20.apache.org,38069,1694545207479 2023-09-12 19:02:26,610 INFO [M:0;jenkins-hbase20:38069] regionserver.HRegionServer(1170): stopping server jenkins-hbase20.apache.org,38069,1694545207479; all regions closed. 2023-09-12 19:02:26,610 DEBUG [M:0;jenkins-hbase20:38069] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-12 19:02:26,610 DEBUG [M:0;jenkins-hbase20:38069] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-12 19:02:26,610 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-12 19:02:26,610 DEBUG [M:0;jenkins-hbase20:38069] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-12 19:02:26,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1694545209790] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.large.0-1694545209790,5,FailOnTimeoutGroup] 2023-09-12 19:02:26,610 DEBUG [master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1694545209791] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase20:0:becomeActiveMaster-HFileCleaner.small.0-1694545209791,5,FailOnTimeoutGroup] 2023-09-12 19:02:26,610 INFO [M:0;jenkins-hbase20:38069] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-12 19:02:26,610 INFO [M:0;jenkins-hbase20:38069] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-12 19:02:26,610 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-12 19:02:26,610 INFO [M:0;jenkins-hbase20:38069] hbase.ChoreService(369): Chore service for: master/jenkins-hbase20:0 had [] on shutdown 2023-09-12 19:02:26,610 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-12 19:02:26,610 DEBUG [M:0;jenkins-hbase20:38069] master.HMaster(1512): Stopping service threads 2023-09-12 19:02:26,610 INFO [M:0;jenkins-hbase20:38069] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-12 19:02:26,611 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-12 19:02:26,611 ERROR [M:0;jenkins-hbase20:38069] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-12 19:02:26,611 INFO [M:0;jenkins-hbase20:38069] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-12 19:02:26,612 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-12 19:02:26,612 DEBUG [M:0;jenkins-hbase20:38069] zookeeper.ZKUtil(398): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-12 19:02:26,612 WARN [M:0;jenkins-hbase20:38069] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-12 19:02:26,612 INFO [M:0;jenkins-hbase20:38069] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-12 19:02:26,612 INFO [M:0;jenkins-hbase20:38069] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-12 19:02:26,613 DEBUG [M:0;jenkins-hbase20:38069] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-12 19:02:26,613 INFO [M:0;jenkins-hbase20:38069] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 19:02:26,613 DEBUG [M:0;jenkins-hbase20:38069] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 19:02:26,613 DEBUG [M:0;jenkins-hbase20:38069] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-12 19:02:26,613 DEBUG [M:0;jenkins-hbase20:38069] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 19:02:26,613 INFO [M:0;jenkins-hbase20:38069] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=376.03 KB heapSize=452.26 KB 2023-09-12 19:02:26,626 INFO [M:0;jenkins-hbase20:38069] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=376.03 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/65adccc308ac47ed95ba9ed5c6665ee9 2023-09-12 19:02:26,630 INFO [M:0;jenkins-hbase20:38069] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65adccc308ac47ed95ba9ed5c6665ee9 2023-09-12 19:02:26,630 DEBUG [M:0;jenkins-hbase20:38069] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/65adccc308ac47ed95ba9ed5c6665ee9 as hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/65adccc308ac47ed95ba9ed5c6665ee9 2023-09-12 19:02:26,634 INFO [M:0;jenkins-hbase20:38069] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 65adccc308ac47ed95ba9ed5c6665ee9 2023-09-12 19:02:26,634 INFO [M:0;jenkins-hbase20:38069] regionserver.HStore(1080): Added hdfs://localhost:36845/user/jenkins/test-data/350a9e64-5bd1-7562-a998-a896ede833c0/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/65adccc308ac47ed95ba9ed5c6665ee9, entries=119, sequenceid=899, filesize=28.6 K 2023-09-12 19:02:26,635 INFO [M:0;jenkins-hbase20:38069] regionserver.HRegion(2948): Finished flush of dataSize ~376.03 KB/385057, heapSize ~452.24 KB/463096, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 22ms, sequenceid=899, compaction requested=false 2023-09-12 19:02:26,636 INFO [M:0;jenkins-hbase20:38069] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-12 19:02:26,636 DEBUG [M:0;jenkins-hbase20:38069] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-12 19:02:26,639 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-12 19:02:26,639 INFO [M:0;jenkins-hbase20:38069] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-12 19:02:26,640 INFO [M:0;jenkins-hbase20:38069] ipc.NettyRpcServer(158): Stopping server on /148.251.75.209:38069 2023-09-12 19:02:26,641 DEBUG [M:0;jenkins-hbase20:38069] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase20.apache.org,38069,1694545207479 already deleted, retry=false 2023-09-12 19:02:26,709 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 19:02:26,709 INFO [RS:2;jenkins-hbase20:36759] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,36759,1694545208602; zookeeper connection closed. 2023-09-12 19:02:26,709 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): regionserver:36759-0x1008d06ae340003, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 19:02:26,709 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6644b761] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6644b761 2023-09-12 19:02:26,710 INFO [Listener at jenkins-hbase20.apache.org/37289] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-12 19:02:26,809 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 19:02:26,809 DEBUG [Listener at localhost/33845-EventThread] zookeeper.ZKWatcher(600): master:38069-0x1008d06ae340000, quorum=127.0.0.1:53172, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-12 19:02:26,809 INFO [M:0;jenkins-hbase20:38069] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase20.apache.org,38069,1694545207479; zookeeper connection closed. 2023-09-12 19:02:26,813 WARN [Listener at jenkins-hbase20.apache.org/37289] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-12 19:02:26,819 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-12 19:02:26,926 WARN [BP-1502435969-148.251.75.209-1694545203900 heartbeating to localhost/127.0.0.1:36845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-12 19:02:26,926 WARN [BP-1502435969-148.251.75.209-1694545203900 heartbeating to localhost/127.0.0.1:36845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1502435969-148.251.75.209-1694545203900 (Datanode Uuid 5095356f-844e-4776-ab5d-9beef59fc9b8) service to localhost/127.0.0.1:36845 2023-09-12 19:02:26,930 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data5/current/BP-1502435969-148.251.75.209-1694545203900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 19:02:26,930 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data6/current/BP-1502435969-148.251.75.209-1694545203900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 19:02:26,931 WARN [Listener at jenkins-hbase20.apache.org/37289] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-12 19:02:26,933 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-12 19:02:27,037 WARN [BP-1502435969-148.251.75.209-1694545203900 heartbeating to localhost/127.0.0.1:36845] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-12 19:02:27,037 WARN [BP-1502435969-148.251.75.209-1694545203900 heartbeating to localhost/127.0.0.1:36845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1502435969-148.251.75.209-1694545203900 (Datanode Uuid cfe64026-3f68-4c30-8451-8f26c1ff6228) service to localhost/127.0.0.1:36845 2023-09-12 19:02:27,039 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data3/current/BP-1502435969-148.251.75.209-1694545203900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 19:02:27,040 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data4/current/BP-1502435969-148.251.75.209-1694545203900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 19:02:27,041 WARN [Listener at jenkins-hbase20.apache.org/37289] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-12 19:02:27,045 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-12 19:02:27,122 WARN [BP-1502435969-148.251.75.209-1694545203900 heartbeating to localhost/127.0.0.1:36845] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1502435969-148.251.75.209-1694545203900 (Datanode Uuid 676c22c9-cf3c-460a-b74a-ff719c721a87) service to localhost/127.0.0.1:36845 2023-09-12 19:02:27,124 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data1/current/BP-1502435969-148.251.75.209-1694545203900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 19:02:27,124 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/9a47cfa2-7ae4-dc9e-5b33-b7b5bf9d9377/cluster_346f14e6-f83f-590a-d58d-54f4ee543614/dfs/data/data2/current/BP-1502435969-148.251.75.209-1694545203900] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-12 19:02:27,169 INFO [Listener at jenkins-hbase20.apache.org/37289] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-12 19:02:27,300 INFO [Listener at jenkins-hbase20.apache.org/37289] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-12 19:02:27,390 INFO [Listener at jenkins-hbase20.apache.org/37289] hbase.HBaseTestingUtility(1293): Minicluster is down