2023-09-27 07:01:03,692 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-09-27 07:01:03,900 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee 2023-09-27 07:01:03,900 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-09-27 07:01:03,901 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-09-27 07:01:03,942 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-09-27 07:01:04,211 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-09-27 07:01:04,212 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a, deleteOnExit=true 2023-09-27 07:01:04,212 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-09-27 07:01:04,213 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/test.cache.data in system properties and HBase conf 2023-09-27 07:01:04,214 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop.tmp.dir in system properties and HBase conf 2023-09-27 07:01:04,214 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop.log.dir in system properties and HBase conf 2023-09-27 07:01:04,215 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-27 07:01:04,215 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-27 07:01:04,215 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-27 07:01:04,550 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-09-27 07:01:04,555 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-27 07:01:04,555 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-27 07:01:04,555 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-27 07:01:04,556 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 07:01:04,556 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-27 07:01:04,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-27 07:01:04,557 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 07:01:04,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 07:01:04,558 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-27 07:01:04,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/nfs.dump.dir in system properties and HBase conf 2023-09-27 07:01:04,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/java.io.tmpdir in system properties and HBase conf 2023-09-27 07:01:04,559 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 07:01:04,560 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-27 07:01:04,560 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-09-27 07:01:05,125 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-27 07:01:05,130 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-27 07:01:05,451 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-09-27 07:01:05,660 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-09-27 07:01:05,678 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 07:01:05,719 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 07:01:05,754 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/java.io.tmpdir/Jetty_localhost_36059_hdfs____.9ywmv9/webapp 2023-09-27 07:01:05,899 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36059 2023-09-27 07:01:05,912 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-09-27 07:01:05,912 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-09-27 07:01:06,463 WARN [Listener at localhost/35855] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 07:01:06,543 WARN [Listener at localhost/35855] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 07:01:06,565 WARN [Listener at localhost/35855] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 07:01:06,624 INFO [Listener at localhost/35855] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 07:01:06,630 INFO [Listener at localhost/35855] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/java.io.tmpdir/Jetty_localhost_45233_datanode____.iup2g8/webapp 2023-09-27 07:01:06,726 INFO [Listener at localhost/35855] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45233 2023-09-27 07:01:07,156 WARN [Listener at localhost/33149] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 07:01:07,170 WARN [Listener at localhost/33149] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 07:01:07,174 WARN [Listener at localhost/33149] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 07:01:07,176 INFO [Listener at localhost/33149] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 07:01:07,190 INFO [Listener at localhost/33149] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/java.io.tmpdir/Jetty_localhost_45113_datanode____.r29dt3/webapp 2023-09-27 07:01:07,323 INFO [Listener at localhost/33149] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45113 2023-09-27 07:01:07,337 WARN [Listener at localhost/40975] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 07:01:07,370 WARN [Listener at localhost/40975] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-09-27 07:01:07,375 WARN [Listener at localhost/40975] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 07:01:07,376 INFO [Listener at localhost/40975] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 07:01:07,383 INFO [Listener at localhost/40975] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/java.io.tmpdir/Jetty_localhost_44293_datanode____age90z/webapp 2023-09-27 07:01:07,510 INFO [Listener at localhost/40975] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44293 2023-09-27 07:01:07,528 WARN [Listener at localhost/43391] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-09-27 07:01:07,742 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6a474c1226fb62d9: Processing first storage report for DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9 from datanode 3dc7c712-0ac5-4edd-ae0d-3b332eba54bc 2023-09-27 07:01:07,744 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6a474c1226fb62d9: from storage DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9 node DatanodeRegistration(127.0.0.1:41983, datanodeUuid=3dc7c712-0ac5-4edd-ae0d-3b332eba54bc, infoPort=34045, infoSecurePort=0, ipcPort=43391, storageInfo=lv=-57;cid=testClusterID;nsid=1840965031;c=1695798065216), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2023-09-27 07:01:07,745 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1c8d1b0637202167: Processing first storage report for DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59 from datanode da7e021d-0ea3-4749-8e47-72377e1c5617 2023-09-27 07:01:07,745 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1c8d1b0637202167: from storage DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59 node DatanodeRegistration(127.0.0.1:45259, datanodeUuid=da7e021d-0ea3-4749-8e47-72377e1c5617, infoPort=44819, infoSecurePort=0, ipcPort=33149, storageInfo=lv=-57;cid=testClusterID;nsid=1840965031;c=1695798065216), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 07:01:07,745 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb35f42cafca177bd: Processing first storage report for DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3 from datanode 053366f6-ec2f-49a7-8e54-cba21a258d51 2023-09-27 07:01:07,745 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb35f42cafca177bd: from storage DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3 node DatanodeRegistration(127.0.0.1:42513, datanodeUuid=053366f6-ec2f-49a7-8e54-cba21a258d51, infoPort=44053, infoSecurePort=0, ipcPort=40975, storageInfo=lv=-57;cid=testClusterID;nsid=1840965031;c=1695798065216), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-09-27 07:01:07,745 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x6a474c1226fb62d9: Processing first storage report for DS-6439986a-a9dd-4ed0-b902-af3d9db195f0 from datanode 3dc7c712-0ac5-4edd-ae0d-3b332eba54bc 2023-09-27 07:01:07,746 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x6a474c1226fb62d9: from storage DS-6439986a-a9dd-4ed0-b902-af3d9db195f0 node DatanodeRegistration(127.0.0.1:41983, datanodeUuid=3dc7c712-0ac5-4edd-ae0d-3b332eba54bc, infoPort=34045, infoSecurePort=0, ipcPort=43391, storageInfo=lv=-57;cid=testClusterID;nsid=1840965031;c=1695798065216), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 07:01:07,746 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1c8d1b0637202167: Processing first storage report for DS-0b0ad020-0d9e-41a9-9d51-725a84d8edd4 from datanode da7e021d-0ea3-4749-8e47-72377e1c5617 2023-09-27 07:01:07,746 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1c8d1b0637202167: from storage DS-0b0ad020-0d9e-41a9-9d51-725a84d8edd4 node DatanodeRegistration(127.0.0.1:45259, datanodeUuid=da7e021d-0ea3-4749-8e47-72377e1c5617, infoPort=44819, infoSecurePort=0, ipcPort=33149, storageInfo=lv=-57;cid=testClusterID;nsid=1840965031;c=1695798065216), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 07:01:07,746 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xb35f42cafca177bd: Processing first storage report for DS-df78f858-6211-4e97-8213-9e6f0b805377 from datanode 053366f6-ec2f-49a7-8e54-cba21a258d51 2023-09-27 07:01:07,746 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xb35f42cafca177bd: from storage DS-df78f858-6211-4e97-8213-9e6f0b805377 node DatanodeRegistration(127.0.0.1:42513, datanodeUuid=053366f6-ec2f-49a7-8e54-cba21a258d51, infoPort=44053, infoSecurePort=0, ipcPort=40975, storageInfo=lv=-57;cid=testClusterID;nsid=1840965031;c=1695798065216), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-09-27 07:01:07,998 DEBUG [Listener at localhost/43391] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee 2023-09-27 07:01:08,091 INFO [Listener at localhost/43391] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/zookeeper_0, clientPort=53388, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-09-27 07:01:08,114 INFO [Listener at localhost/43391] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=53388 2023-09-27 07:01:08,125 INFO [Listener at localhost/43391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:08,127 INFO [Listener at localhost/43391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:08,841 INFO [Listener at localhost/43391] util.FSUtils(471): Created version file at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 with version=8 2023-09-27 07:01:08,842 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/hbase-staging 2023-09-27 07:01:09,196 INFO [Listener at localhost/43391] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-09-27 07:01:09,689 INFO [Listener at localhost/43391] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-09-27 07:01:09,724 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:09,724 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:09,725 INFO [Listener at localhost/43391] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 07:01:09,725 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:09,725 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 07:01:09,870 INFO [Listener at localhost/43391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 07:01:09,946 DEBUG [Listener at localhost/43391] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-09-27 07:01:10,072 INFO [Listener at localhost/43391] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41725 2023-09-27 07:01:10,085 INFO [Listener at localhost/43391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:10,087 INFO [Listener at localhost/43391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:10,112 INFO [Listener at localhost/43391] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41725 connecting to ZooKeeper ensemble=127.0.0.1:53388 2023-09-27 07:01:10,170 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:417250x0, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 07:01:10,173 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41725-0x100ec303b0a0000 connected 2023-09-27 07:01:10,205 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 07:01:10,206 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 07:01:10,219 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 07:01:10,231 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41725 2023-09-27 07:01:10,232 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41725 2023-09-27 07:01:10,232 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41725 2023-09-27 07:01:10,233 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41725 2023-09-27 07:01:10,233 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41725 2023-09-27 07:01:10,240 INFO [Listener at localhost/43391] master.HMaster(444): hbase.rootdir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18, hbase.cluster.distributed=false 2023-09-27 07:01:10,304 INFO [Listener at localhost/43391] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-27 07:01:10,305 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:10,305 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:10,305 INFO [Listener at localhost/43391] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 07:01:10,305 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:10,305 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 07:01:10,310 INFO [Listener at localhost/43391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 07:01:10,313 INFO [Listener at localhost/43391] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33339 2023-09-27 07:01:10,316 INFO [Listener at localhost/43391] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 07:01:10,323 INFO [Listener at localhost/43391] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 07:01:10,324 INFO [Listener at localhost/43391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:10,326 INFO [Listener at localhost/43391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:10,328 INFO [Listener at localhost/43391] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33339 connecting to ZooKeeper ensemble=127.0.0.1:53388 2023-09-27 07:01:10,333 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:333390x0, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 07:01:10,334 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): regionserver:333390x0, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 07:01:10,337 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33339-0x100ec303b0a0001 connected 2023-09-27 07:01:10,337 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 07:01:10,338 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 07:01:10,341 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33339 2023-09-27 07:01:10,341 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33339 2023-09-27 07:01:10,342 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33339 2023-09-27 07:01:10,342 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33339 2023-09-27 07:01:10,343 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33339 2023-09-27 07:01:10,355 INFO [Listener at localhost/43391] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-27 07:01:10,356 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:10,356 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:10,356 INFO [Listener at localhost/43391] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 07:01:10,357 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:10,357 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 07:01:10,357 INFO [Listener at localhost/43391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 07:01:10,361 INFO [Listener at localhost/43391] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43767 2023-09-27 07:01:10,362 INFO [Listener at localhost/43391] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 07:01:10,363 INFO [Listener at localhost/43391] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 07:01:10,364 INFO [Listener at localhost/43391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:10,365 INFO [Listener at localhost/43391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:10,367 INFO [Listener at localhost/43391] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43767 connecting to ZooKeeper ensemble=127.0.0.1:53388 2023-09-27 07:01:10,371 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:437670x0, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 07:01:10,373 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43767-0x100ec303b0a0002 connected 2023-09-27 07:01:10,373 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 07:01:10,374 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 07:01:10,375 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 07:01:10,377 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43767 2023-09-27 07:01:10,377 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43767 2023-09-27 07:01:10,378 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43767 2023-09-27 07:01:10,378 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43767 2023-09-27 07:01:10,381 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43767 2023-09-27 07:01:10,394 INFO [Listener at localhost/43391] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-09-27 07:01:10,394 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:10,394 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:10,394 INFO [Listener at localhost/43391] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-09-27 07:01:10,394 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-09-27 07:01:10,395 INFO [Listener at localhost/43391] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-09-27 07:01:10,395 INFO [Listener at localhost/43391] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-09-27 07:01:10,396 INFO [Listener at localhost/43391] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40331 2023-09-27 07:01:10,397 INFO [Listener at localhost/43391] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-09-27 07:01:10,398 INFO [Listener at localhost/43391] mob.MobFileCache(124): MobFileCache disabled 2023-09-27 07:01:10,399 INFO [Listener at localhost/43391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:10,401 INFO [Listener at localhost/43391] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:10,403 INFO [Listener at localhost/43391] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40331 connecting to ZooKeeper ensemble=127.0.0.1:53388 2023-09-27 07:01:10,407 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:403310x0, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-09-27 07:01:10,408 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40331-0x100ec303b0a0003 connected 2023-09-27 07:01:10,408 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 07:01:10,409 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 07:01:10,410 DEBUG [Listener at localhost/43391] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-09-27 07:01:10,410 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40331 2023-09-27 07:01:10,411 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40331 2023-09-27 07:01:10,413 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40331 2023-09-27 07:01:10,417 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40331 2023-09-27 07:01:10,417 DEBUG [Listener at localhost/43391] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40331 2023-09-27 07:01:10,419 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41725,1695798069016 2023-09-27 07:01:10,430 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-27 07:01:10,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41725,1695798069016 2023-09-27 07:01:10,452 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 07:01:10,452 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 07:01:10,452 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 07:01:10,452 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-09-27 07:01:10,453 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:01:10,454 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-27 07:01:10,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41725,1695798069016 from backup master directory 2023-09-27 07:01:10,457 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-09-27 07:01:10,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41725,1695798069016 2023-09-27 07:01:10,462 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-09-27 07:01:10,462 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 07:01:10,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41725,1695798069016 2023-09-27 07:01:10,466 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-09-27 07:01:10,468 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-09-27 07:01:10,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/hbase.id with ID: 1ae706a2-4acb-40ef-938b-6bf5976f1f40 2023-09-27 07:01:10,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-09-27 07:01:10,630 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:01:10,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5c5c1e5b to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:10,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2bfe1efa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:10,749 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-27 07:01:10,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-09-27 07:01:10,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-09-27 07:01:10,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-09-27 07:01:10,772 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-27 07:01:10,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-09-27 07:01:10,778 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 07:01:10,815 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/data/master/store-tmp 2023-09-27 07:01:10,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:10,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-27 07:01:10,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 07:01:10,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 07:01:10,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-27 07:01:10,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 07:01:10,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 07:01:10,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 07:01:10,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/WALs/jenkins-hbase4.apache.org,41725,1695798069016 2023-09-27 07:01:10,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41725%2C1695798069016, suffix=, logDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/WALs/jenkins-hbase4.apache.org,41725,1695798069016, archiveDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/oldWALs, maxLogs=10 2023-09-27 07:01:10,946 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42513,DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3,DISK] 2023-09-27 07:01:10,946 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45259,DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59,DISK] 2023-09-27 07:01:10,946 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41983,DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9,DISK] 2023-09-27 07:01:10,957 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-09-27 07:01:11,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/WALs/jenkins-hbase4.apache.org,41725,1695798069016/jenkins-hbase4.apache.org%2C41725%2C1695798069016.1695798070898 2023-09-27 07:01:11,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45259,DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59,DISK], DatanodeInfoWithStorage[127.0.0.1:42513,DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3,DISK], DatanodeInfoWithStorage[127.0.0.1:41983,DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9,DISK]] 2023-09-27 07:01:11,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-09-27 07:01:11,026 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:11,031 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 07:01:11,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 07:01:11,102 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-09-27 07:01:11,110 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-09-27 07:01:11,138 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-09-27 07:01:11,151 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:11,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-27 07:01:11,160 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-09-27 07:01:11,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-09-27 07:01:11,184 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:01:11,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71758793, jitterRate=0.06928934156894684}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:01:11,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 07:01:11,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-09-27 07:01:11,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-09-27 07:01:11,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(561): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-09-27 07:01:11,216 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-09-27 07:01:11,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(581): Recovered RegionProcedureStore lease in 1 msec 2023-09-27 07:01:11,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(595): Loaded RegionProcedureStore in 37 msec 2023-09-27 07:01:11,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-09-27 07:01:11,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-09-27 07:01:11,292 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-09-27 07:01:11,317 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-09-27 07:01:11,322 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-09-27 07:01:11,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-09-27 07:01:11,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.SimpleRegionNormalizer(156): Updated configuration for key 'hbase.normalizer.merge.merge_request_max_number_of_regions' from 100 to 50 2023-09-27 07:01:11,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-09-27 07:01:11,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-09-27 07:01:11,338 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:01:11,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-09-27 07:01:11,341 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-09-27 07:01:11,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-09-27 07:01:11,360 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 07:01:11,360 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 07:01:11,360 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 07:01:11,360 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-09-27 07:01:11,360 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:01:11,361 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,41725,1695798069016, sessionid=0x100ec303b0a0000, setting cluster-up flag (Was=false) 2023-09-27 07:01:11,388 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:01:11,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-09-27 07:01:11,395 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41725,1695798069016 2023-09-27 07:01:11,402 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:01:11,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-09-27 07:01:11,411 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41725,1695798069016 2023-09-27 07:01:11,415 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp 2023-09-27 07:01:11,422 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(951): ClusterId : 1ae706a2-4acb-40ef-938b-6bf5976f1f40 2023-09-27 07:01:11,423 INFO [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(951): ClusterId : 1ae706a2-4acb-40ef-938b-6bf5976f1f40 2023-09-27 07:01:11,422 INFO [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(951): ClusterId : 1ae706a2-4acb-40ef-938b-6bf5976f1f40 2023-09-27 07:01:11,429 DEBUG [RS:1;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 07:01:11,429 DEBUG [RS:0;jenkins-hbase4:33339] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 07:01:11,429 DEBUG [RS:2;jenkins-hbase4:40331] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-09-27 07:01:11,437 DEBUG [RS:0;jenkins-hbase4:33339] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 07:01:11,437 DEBUG [RS:2;jenkins-hbase4:40331] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 07:01:11,437 DEBUG [RS:1;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-09-27 07:01:11,437 DEBUG [RS:2;jenkins-hbase4:40331] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 07:01:11,437 DEBUG [RS:0;jenkins-hbase4:33339] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 07:01:11,437 DEBUG [RS:1;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-09-27 07:01:11,442 DEBUG [RS:1;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 07:01:11,442 DEBUG [RS:2;jenkins-hbase4:40331] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 07:01:11,442 DEBUG [RS:0;jenkins-hbase4:33339] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-09-27 07:01:11,446 DEBUG [RS:0;jenkins-hbase4:33339] zookeeper.ReadOnlyZKClient(139): Connect 0x6a2b73db to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:11,447 DEBUG [RS:2;jenkins-hbase4:40331] zookeeper.ReadOnlyZKClient(139): Connect 0x5728a773 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:11,447 DEBUG [RS:1;jenkins-hbase4:43767] zookeeper.ReadOnlyZKClient(139): Connect 0x76851eb1 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:11,458 DEBUG [RS:0;jenkins-hbase4:33339] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64ec80ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:11,459 DEBUG [RS:0;jenkins-hbase4:33339] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60d318ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-27 07:01:11,460 DEBUG [RS:2;jenkins-hbase4:40331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@59ef53e6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:11,460 DEBUG [RS:2;jenkins-hbase4:40331] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dd0cc03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-27 07:01:11,496 DEBUG [RS:1;jenkins-hbase4:43767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7842ee11, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:11,497 DEBUG [RS:1;jenkins-hbase4:43767] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c7d75c1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-27 07:01:11,519 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33339 2023-09-27 07:01:11,523 DEBUG [RS:1;jenkins-hbase4:43767] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43767 2023-09-27 07:01:11,523 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:40331 2023-09-27 07:01:11,524 INFO [RS:0;jenkins-hbase4:33339] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 07:01:11,524 INFO [RS:2;jenkins-hbase4:40331] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 07:01:11,525 INFO [RS:2;jenkins-hbase4:40331] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 07:01:11,524 INFO [RS:1;jenkins-hbase4:43767] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-09-27 07:01:11,525 INFO [RS:0;jenkins-hbase4:33339] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 07:01:11,525 INFO [RS:1;jenkins-hbase4:43767] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-09-27 07:01:11,555 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 07:01:11,555 DEBUG [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 07:01:11,555 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-09-27 07:01:11,555 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-09-27 07:01:11,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:11,558 INFO [RS:1;jenkins-hbase4:43767] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:11,558 INFO [RS:2;jenkins-hbase4:40331] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:11,558 INFO [RS:0;jenkins-hbase4:33339] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:11,558 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 07:01:11,558 DEBUG [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 07:01:11,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-09-27 07:01:11,558 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1022): About to register with Master. 2023-09-27 07:01:11,562 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41725,1695798069016 with isa=jenkins-hbase4.apache.org/172.31.14.131:40331, startcode=1695798070393 2023-09-27 07:01:11,562 INFO [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41725,1695798069016 with isa=jenkins-hbase4.apache.org/172.31.14.131:43767, startcode=1695798070355 2023-09-27 07:01:11,562 INFO [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41725,1695798069016 with isa=jenkins-hbase4.apache.org/172.31.14.131:33339, startcode=1695798070304 2023-09-27 07:01:11,584 DEBUG [RS:2;jenkins-hbase4:40331] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 07:01:11,584 DEBUG [RS:0;jenkins-hbase4:33339] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 07:01:11,584 DEBUG [RS:1;jenkins-hbase4:43767] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-09-27 07:01:11,647 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54455, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 07:01:11,647 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38565, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 07:01:11,647 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60953, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-09-27 07:01:11,651 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-09-27 07:01:11,656 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41725] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-27 07:01:11,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-27 07:01:11,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-27 07:01:11,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-27 07:01:11,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-09-27 07:01:11,665 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-09-27 07:01:11,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-27 07:01:11,666 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,666 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41725] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-27 07:01:11,667 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41725] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-09-27 07:01:11,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1695798101669 2023-09-27 07:01:11,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-09-27 07:01:11,683 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-09-27 07:01:11,684 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-09-27 07:01:11,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-09-27 07:01:11,688 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 07:01:11,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-09-27 07:01:11,696 DEBUG [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(2830): Master is not running yet 2023-09-27 07:01:11,696 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(2830): Master is not running yet 2023-09-27 07:01:11,696 WARN [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-27 07:01:11,696 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(2830): Master is not running yet 2023-09-27 07:01:11,696 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-09-27 07:01:11,696 WARN [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-27 07:01:11,696 WARN [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-09-27 07:01:11,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-09-27 07:01:11,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-09-27 07:01:11,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-09-27 07:01:11,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-09-27 07:01:11,702 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-09-27 07:01:11,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-09-27 07:01:11,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-09-27 07:01:11,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695798071708,5,FailOnTimeoutGroup] 2023-09-27 07:01:11,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695798071709,5,FailOnTimeoutGroup] 2023-09-27 07:01:11,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-09-27 07:01:11,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,729 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-27 07:01:11,730 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-09-27 07:01:11,730 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:01:11,753 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:11,756 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-27 07:01:11,758 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/info 2023-09-27 07:01:11,759 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-27 07:01:11,760 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:11,760 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-27 07:01:11,762 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/rep_barrier 2023-09-27 07:01:11,763 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-27 07:01:11,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:11,764 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-27 07:01:11,766 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/table 2023-09-27 07:01:11,766 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-27 07:01:11,767 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:11,769 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740 2023-09-27 07:01:11,770 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740 2023-09-27 07:01:11,773 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-27 07:01:11,776 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-27 07:01:11,780 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:01:11,781 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58934796, jitterRate=-0.12180310487747192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-27 07:01:11,781 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-27 07:01:11,781 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-27 07:01:11,781 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-27 07:01:11,781 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-27 07:01:11,781 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-27 07:01:11,781 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-27 07:01:11,786 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-27 07:01:11,786 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-27 07:01:11,793 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-09-27 07:01:11,793 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-09-27 07:01:11,798 INFO [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41725,1695798069016 with isa=jenkins-hbase4.apache.org/172.31.14.131:43767, startcode=1695798070355 2023-09-27 07:01:11,798 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41725,1695798069016 with isa=jenkins-hbase4.apache.org/172.31.14.131:40331, startcode=1695798070393 2023-09-27 07:01:11,798 INFO [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,41725,1695798069016 with isa=jenkins-hbase4.apache.org/172.31.14.131:33339, startcode=1695798070304 2023-09-27 07:01:11,805 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41725] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:11,805 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-09-27 07:01:11,813 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41725] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:11,814 DEBUG [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:01:11,814 DEBUG [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35855 2023-09-27 07:01:11,814 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41725] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:11,814 DEBUG [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 07:01:11,815 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:01:11,815 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35855 2023-09-27 07:01:11,815 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 07:01:11,816 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:01:11,816 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35855 2023-09-27 07:01:11,816 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-09-27 07:01:11,820 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-09-27 07:01:11,823 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-09-27 07:01:11,828 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 07:01:11,830 DEBUG [RS:2;jenkins-hbase4:40331] zookeeper.ZKUtil(162): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:11,830 WARN [RS:2;jenkins-hbase4:40331] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 07:01:11,830 INFO [RS:2;jenkins-hbase4:40331] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 07:01:11,830 DEBUG [RS:1;jenkins-hbase4:43767] zookeeper.ZKUtil(162): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:11,830 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:11,831 DEBUG [RS:0;jenkins-hbase4:33339] zookeeper.ZKUtil(162): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:11,830 WARN [RS:1;jenkins-hbase4:43767] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 07:01:11,831 WARN [RS:0;jenkins-hbase4:33339] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-09-27 07:01:11,831 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40331,1695798070393] 2023-09-27 07:01:11,832 INFO [RS:0;jenkins-hbase4:33339] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 07:01:11,831 INFO [RS:1;jenkins-hbase4:43767] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 07:01:11,832 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:11,832 DEBUG [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:11,832 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43767,1695798070355] 2023-09-27 07:01:11,833 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33339,1695798070304] 2023-09-27 07:01:11,849 DEBUG [RS:1;jenkins-hbase4:43767] zookeeper.ZKUtil(162): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:11,849 DEBUG [RS:2;jenkins-hbase4:40331] zookeeper.ZKUtil(162): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:11,849 DEBUG [RS:0;jenkins-hbase4:33339] zookeeper.ZKUtil(162): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:11,849 DEBUG [RS:1;jenkins-hbase4:43767] zookeeper.ZKUtil(162): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:11,850 DEBUG [RS:1;jenkins-hbase4:43767] zookeeper.ZKUtil(162): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:11,850 DEBUG [RS:2;jenkins-hbase4:40331] zookeeper.ZKUtil(162): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:11,850 DEBUG [RS:0;jenkins-hbase4:33339] zookeeper.ZKUtil(162): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:11,851 DEBUG [RS:2;jenkins-hbase4:40331] zookeeper.ZKUtil(162): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:11,851 DEBUG [RS:0;jenkins-hbase4:33339] zookeeper.ZKUtil(162): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:11,862 DEBUG [RS:1;jenkins-hbase4:43767] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 07:01:11,862 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 07:01:11,862 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-09-27 07:01:11,873 INFO [RS:2;jenkins-hbase4:40331] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 07:01:11,874 INFO [RS:1;jenkins-hbase4:43767] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 07:01:11,873 INFO [RS:0;jenkins-hbase4:33339] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-09-27 07:01:11,899 INFO [RS:2;jenkins-hbase4:40331] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 07:01:11,899 INFO [RS:1;jenkins-hbase4:43767] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 07:01:11,899 INFO [RS:0;jenkins-hbase4:33339] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-09-27 07:01:11,904 INFO [RS:2;jenkins-hbase4:40331] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 07:01:11,904 INFO [RS:0;jenkins-hbase4:33339] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 07:01:11,905 INFO [RS:2;jenkins-hbase4:40331] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,904 INFO [RS:1;jenkins-hbase4:43767] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-09-27 07:01:11,905 INFO [RS:0;jenkins-hbase4:33339] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,905 INFO [RS:1;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,907 INFO [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 07:01:11,907 INFO [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 07:01:11,907 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-09-27 07:01:11,915 INFO [RS:1;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,915 INFO [RS:0;jenkins-hbase4:33339] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,915 INFO [RS:2;jenkins-hbase4:40331] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,915 DEBUG [RS:1;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,916 DEBUG [RS:0;jenkins-hbase4:33339] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,916 DEBUG [RS:1;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,916 DEBUG [RS:0;jenkins-hbase4:33339] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,916 DEBUG [RS:2;jenkins-hbase4:40331] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,916 DEBUG [RS:0;jenkins-hbase4:33339] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,916 DEBUG [RS:2;jenkins-hbase4:40331] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,916 DEBUG [RS:1;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,916 DEBUG [RS:2;jenkins-hbase4:40331] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:1;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:2;jenkins-hbase4:40331] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:1;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:2;jenkins-hbase4:40331] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:1;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-27 07:01:11,917 DEBUG [RS:2;jenkins-hbase4:40331] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-27 07:01:11,917 DEBUG [RS:1;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:2;jenkins-hbase4:40331] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,916 DEBUG [RS:0;jenkins-hbase4:33339] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:2;jenkins-hbase4:40331] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:1;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:2;jenkins-hbase4:40331] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:1;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:2;jenkins-hbase4:40331] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:1;jenkins-hbase4:43767] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,917 DEBUG [RS:0;jenkins-hbase4:33339] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,918 DEBUG [RS:0;jenkins-hbase4:33339] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-09-27 07:01:11,919 DEBUG [RS:0;jenkins-hbase4:33339] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,919 DEBUG [RS:0;jenkins-hbase4:33339] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,919 DEBUG [RS:0;jenkins-hbase4:33339] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,919 DEBUG [RS:0;jenkins-hbase4:33339] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-09-27 07:01:11,920 INFO [RS:1;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,920 INFO [RS:2;jenkins-hbase4:40331] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,920 INFO [RS:1;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,920 INFO [RS:2;jenkins-hbase4:40331] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,920 INFO [RS:1;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,920 INFO [RS:2;jenkins-hbase4:40331] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,925 INFO [RS:0;jenkins-hbase4:33339] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,925 INFO [RS:0;jenkins-hbase4:33339] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,925 INFO [RS:0;jenkins-hbase4:33339] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,943 INFO [RS:1;jenkins-hbase4:43767] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 07:01:11,943 INFO [RS:2;jenkins-hbase4:40331] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 07:01:11,943 INFO [RS:0;jenkins-hbase4:33339] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-09-27 07:01:11,947 INFO [RS:0;jenkins-hbase4:33339] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33339,1695798070304-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,947 INFO [RS:2;jenkins-hbase4:40331] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40331,1695798070393-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,947 INFO [RS:1;jenkins-hbase4:43767] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43767,1695798070355-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:11,969 INFO [RS:1;jenkins-hbase4:43767] regionserver.Replication(203): jenkins-hbase4.apache.org,43767,1695798070355 started 2023-09-27 07:01:11,969 INFO [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43767,1695798070355, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43767, sessionid=0x100ec303b0a0002 2023-09-27 07:01:11,971 INFO [RS:2;jenkins-hbase4:40331] regionserver.Replication(203): jenkins-hbase4.apache.org,40331,1695798070393 started 2023-09-27 07:01:11,972 INFO [RS:0;jenkins-hbase4:33339] regionserver.Replication(203): jenkins-hbase4.apache.org,33339,1695798070304 started 2023-09-27 07:01:11,972 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,40331,1695798070393, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40331, sessionid=0x100ec303b0a0003 2023-09-27 07:01:11,971 DEBUG [RS:1;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 07:01:11,972 DEBUG [RS:2;jenkins-hbase4:40331] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 07:01:11,972 DEBUG [RS:1;jenkins-hbase4:43767] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:11,972 DEBUG [RS:2;jenkins-hbase4:40331] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:11,972 INFO [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,33339,1695798070304, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33339, sessionid=0x100ec303b0a0001 2023-09-27 07:01:11,973 DEBUG [RS:2;jenkins-hbase4:40331] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40331,1695798070393' 2023-09-27 07:01:11,973 DEBUG [RS:0;jenkins-hbase4:33339] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-09-27 07:01:11,973 DEBUG [RS:1;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43767,1695798070355' 2023-09-27 07:01:11,973 DEBUG [RS:0;jenkins-hbase4:33339] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:11,974 DEBUG [RS:0;jenkins-hbase4:33339] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33339,1695798070304' 2023-09-27 07:01:11,973 DEBUG [RS:2;jenkins-hbase4:40331] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 07:01:11,974 DEBUG [RS:0;jenkins-hbase4:33339] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 07:01:11,973 DEBUG [RS:1;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-09-27 07:01:11,975 DEBUG [RS:2;jenkins-hbase4:40331] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 07:01:11,975 DEBUG [RS:0;jenkins-hbase4:33339] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 07:01:11,975 DEBUG [RS:1;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-09-27 07:01:11,975 DEBUG [jenkins-hbase4:41725] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-09-27 07:01:11,975 DEBUG [RS:0;jenkins-hbase4:33339] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 07:01:11,976 DEBUG [RS:0;jenkins-hbase4:33339] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 07:01:11,976 DEBUG [RS:0;jenkins-hbase4:33339] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:11,976 DEBUG [RS:0;jenkins-hbase4:33339] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33339,1695798070304' 2023-09-27 07:01:11,976 DEBUG [RS:0;jenkins-hbase4:33339] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:11,976 DEBUG [RS:1;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 07:01:11,976 DEBUG [RS:1;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 07:01:11,976 DEBUG [RS:1;jenkins-hbase4:43767] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:11,978 DEBUG [RS:1;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43767,1695798070355' 2023-09-27 07:01:11,978 DEBUG [RS:1;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:11,979 DEBUG [RS:0;jenkins-hbase4:33339] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:11,979 DEBUG [RS:2;jenkins-hbase4:40331] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-09-27 07:01:11,979 DEBUG [RS:1;jenkins-hbase4:43767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:11,979 DEBUG [RS:2;jenkins-hbase4:40331] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-09-27 07:01:11,980 DEBUG [RS:1;jenkins-hbase4:43767] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 07:01:11,980 DEBUG [RS:0;jenkins-hbase4:33339] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 07:01:11,980 INFO [RS:1;jenkins-hbase4:43767] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 07:01:11,980 INFO [RS:0;jenkins-hbase4:33339] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 07:01:11,980 DEBUG [RS:2;jenkins-hbase4:40331] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:11,981 INFO [RS:0;jenkins-hbase4:33339] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 07:01:11,981 INFO [RS:1;jenkins-hbase4:43767] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 07:01:11,981 DEBUG [RS:2;jenkins-hbase4:40331] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40331,1695798070393' 2023-09-27 07:01:11,981 DEBUG [RS:2;jenkins-hbase4:40331] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:11,981 DEBUG [RS:2;jenkins-hbase4:40331] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:11,982 DEBUG [jenkins-hbase4:41725] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 07:01:11,982 DEBUG [RS:2;jenkins-hbase4:40331] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-09-27 07:01:11,982 INFO [RS:2;jenkins-hbase4:40331] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-09-27 07:01:11,982 INFO [RS:2;jenkins-hbase4:40331] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-09-27 07:01:11,989 DEBUG [jenkins-hbase4:41725] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 07:01:11,989 DEBUG [jenkins-hbase4:41725] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 07:01:11,989 DEBUG [jenkins-hbase4:41725] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 07:01:11,989 DEBUG [jenkins-hbase4:41725] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 07:01:11,992 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33339,1695798070304, state=OPENING 2023-09-27 07:01:12,000 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-09-27 07:01:12,002 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:01:12,003 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-27 07:01:12,007 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33339,1695798070304}] 2023-09-27 07:01:12,096 INFO [RS:1;jenkins-hbase4:43767] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43767%2C1695798070355, suffix=, logDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,43767,1695798070355, archiveDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/oldWALs, maxLogs=32 2023-09-27 07:01:12,096 INFO [RS:2;jenkins-hbase4:40331] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40331%2C1695798070393, suffix=, logDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,40331,1695798070393, archiveDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/oldWALs, maxLogs=32 2023-09-27 07:01:12,096 INFO [RS:0;jenkins-hbase4:33339] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33339%2C1695798070304, suffix=, logDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,33339,1695798070304, archiveDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/oldWALs, maxLogs=32 2023-09-27 07:01:12,126 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42513,DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3,DISK] 2023-09-27 07:01:12,126 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41983,DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9,DISK] 2023-09-27 07:01:12,126 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45259,DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59,DISK] 2023-09-27 07:01:12,137 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41983,DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9,DISK] 2023-09-27 07:01:12,144 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42513,DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3,DISK] 2023-09-27 07:01:12,144 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45259,DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59,DISK] 2023-09-27 07:01:12,144 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42513,DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3,DISK] 2023-09-27 07:01:12,145 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41983,DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9,DISK] 2023-09-27 07:01:12,145 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45259,DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59,DISK] 2023-09-27 07:01:12,149 INFO [RS:2;jenkins-hbase4:40331] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,40331,1695798070393/jenkins-hbase4.apache.org%2C40331%2C1695798070393.1695798072101 2023-09-27 07:01:12,154 INFO [RS:1;jenkins-hbase4:43767] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,43767,1695798070355/jenkins-hbase4.apache.org%2C43767%2C1695798070355.1695798072101 2023-09-27 07:01:12,157 DEBUG [RS:2;jenkins-hbase4:40331] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42513,DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3,DISK], DatanodeInfoWithStorage[127.0.0.1:41983,DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9,DISK], DatanodeInfoWithStorage[127.0.0.1:45259,DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59,DISK]] 2023-09-27 07:01:12,158 DEBUG [RS:1;jenkins-hbase4:43767] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45259,DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59,DISK], DatanodeInfoWithStorage[127.0.0.1:42513,DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3,DISK], DatanodeInfoWithStorage[127.0.0.1:41983,DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9,DISK]] 2023-09-27 07:01:12,158 INFO [RS:0;jenkins-hbase4:33339] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,33339,1695798070304/jenkins-hbase4.apache.org%2C33339%2C1695798070304.1695798072101 2023-09-27 07:01:12,159 DEBUG [RS:0;jenkins-hbase4:33339] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42513,DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3,DISK], DatanodeInfoWithStorage[127.0.0.1:41983,DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9,DISK], DatanodeInfoWithStorage[127.0.0.1:45259,DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59,DISK]] 2023-09-27 07:01:12,206 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:12,209 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 07:01:12,213 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 07:01:12,226 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-09-27 07:01:12,227 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-09-27 07:01:12,233 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33339%2C1695798070304.meta, suffix=.meta, logDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,33339,1695798070304, archiveDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/oldWALs, maxLogs=32 2023-09-27 07:01:12,258 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45259,DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59,DISK] 2023-09-27 07:01:12,260 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42513,DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3,DISK] 2023-09-27 07:01:12,260 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41983,DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9,DISK] 2023-09-27 07:01:12,271 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/WALs/jenkins-hbase4.apache.org,33339,1695798070304/jenkins-hbase4.apache.org%2C33339%2C1695798070304.meta.1695798072235.meta 2023-09-27 07:01:12,272 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45259,DS-6dd1fc93-d9ad-4365-895c-14fffe05cc59,DISK], DatanodeInfoWithStorage[127.0.0.1:42513,DS-48d5dec9-ff5f-4b99-95ba-9d63953a7ff3,DISK], DatanodeInfoWithStorage[127.0.0.1:41983,DS-c8b14b23-48a4-4e8a-abd0-66293867b6d9,DISK]] 2023-09-27 07:01:12,272 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-09-27 07:01:12,273 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-09-27 07:01:12,274 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:12,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-09-27 07:01:12,277 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-09-27 07:01:12,279 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-09-27 07:01:12,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-09-27 07:01:12,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:12,302 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-09-27 07:01:12,303 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-09-27 07:01:12,306 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-09-27 07:01:12,308 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/info 2023-09-27 07:01:12,308 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/info 2023-09-27 07:01:12,308 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-09-27 07:01:12,309 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:12,309 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-09-27 07:01:12,311 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/rep_barrier 2023-09-27 07:01:12,311 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/rep_barrier 2023-09-27 07:01:12,311 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-09-27 07:01:12,312 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:12,312 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-09-27 07:01:12,314 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/table 2023-09-27 07:01:12,314 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/table 2023-09-27 07:01:12,315 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-09-27 07:01:12,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:12,317 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740 2023-09-27 07:01:12,320 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740 2023-09-27 07:01:12,324 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-09-27 07:01:12,326 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-09-27 07:01:12,328 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75208277, jitterRate=0.12069065868854523}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-09-27 07:01:12,330 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-09-27 07:01:12,340 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1695798072194 2023-09-27 07:01:12,359 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-09-27 07:01:12,360 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-09-27 07:01:12,360 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,33339,1695798070304, state=OPEN 2023-09-27 07:01:12,363 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-09-27 07:01:12,363 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-09-27 07:01:12,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=3, resume processing ppid=2 2023-09-27 07:01:12,369 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,33339,1695798070304 in 357 msec 2023-09-27 07:01:12,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=2, resume processing ppid=1 2023-09-27 07:01:12,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 566 msec 2023-09-27 07:01:12,380 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 812 msec 2023-09-27 07:01:12,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1695798072381, completionTime=-1 2023-09-27 07:01:12,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-09-27 07:01:12,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-09-27 07:01:12,453 DEBUG [hconnection-0x12aa2eb7-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:12,457 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37096, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:12,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-09-27 07:01:12,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1695798132479 2023-09-27 07:01:12,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1695798192479 2023-09-27 07:01:12,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 98 msec 2023-09-27 07:01:12,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41725,1695798069016-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:12,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41725,1695798069016-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:12,516 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41725,1695798069016-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:12,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41725, period=300000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:12,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-09-27 07:01:12,527 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-09-27 07:01:12,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-09-27 07:01:12,542 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 07:01:12,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-09-27 07:01:12,558 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 07:01:12,562 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 07:01:12,586 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:01:12,589 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e empty. 2023-09-27 07:01:12,589 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:01:12,590 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-09-27 07:01:12,632 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-09-27 07:01:12,634 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => adea58e84d4895d882491dd24dce5c4e, NAME => 'hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:01:12,653 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:12,653 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing adea58e84d4895d882491dd24dce5c4e, disabling compactions & flushes 2023-09-27 07:01:12,653 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:01:12,653 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:01:12,653 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. after waiting 0 ms 2023-09-27 07:01:12,653 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:01:12,653 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:01:12,653 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for adea58e84d4895d882491dd24dce5c4e: 2023-09-27 07:01:12,658 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 07:01:12,673 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695798072661"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798072661"}]},"ts":"1695798072661"} 2023-09-27 07:01:12,704 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-27 07:01:12,707 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 07:01:12,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798072707"}]},"ts":"1695798072707"} 2023-09-27 07:01:12,716 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-09-27 07:01:12,721 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 07:01:12,723 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 07:01:12,723 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 07:01:12,723 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 07:01:12,723 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 07:01:12,725 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=adea58e84d4895d882491dd24dce5c4e, ASSIGN}] 2023-09-27 07:01:12,729 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=adea58e84d4895d882491dd24dce5c4e, ASSIGN 2023-09-27 07:01:12,732 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=adea58e84d4895d882491dd24dce5c4e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40331,1695798070393; forceNewPlan=false, retain=false 2023-09-27 07:01:12,884 INFO [jenkins-hbase4:41725] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 07:01:12,886 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=adea58e84d4895d882491dd24dce5c4e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:12,886 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695798072885"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798072885"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798072885"}]},"ts":"1695798072885"} 2023-09-27 07:01:12,893 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure adea58e84d4895d882491dd24dce5c4e, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:01:13,048 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:13,049 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 07:01:13,052 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 07:01:13,059 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:01:13,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => adea58e84d4895d882491dd24dce5c4e, NAME => 'hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e.', STARTKEY => '', ENDKEY => ''} 2023-09-27 07:01:13,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. service=AccessControlService 2023-09-27 07:01:13,061 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:13,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:01:13,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:13,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:01:13,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:01:13,064 INFO [StoreOpener-adea58e84d4895d882491dd24dce5c4e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:01:13,067 DEBUG [StoreOpener-adea58e84d4895d882491dd24dce5c4e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e/info 2023-09-27 07:01:13,067 DEBUG [StoreOpener-adea58e84d4895d882491dd24dce5c4e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e/info 2023-09-27 07:01:13,067 INFO [StoreOpener-adea58e84d4895d882491dd24dce5c4e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region adea58e84d4895d882491dd24dce5c4e columnFamilyName info 2023-09-27 07:01:13,068 INFO [StoreOpener-adea58e84d4895d882491dd24dce5c4e-1] regionserver.HStore(310): Store=adea58e84d4895d882491dd24dce5c4e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:13,070 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:01:13,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:01:13,076 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:01:13,080 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:01:13,081 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened adea58e84d4895d882491dd24dce5c4e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69355527, jitterRate=0.03347788751125336}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:01:13,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for adea58e84d4895d882491dd24dce5c4e: 2023-09-27 07:01:13,083 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e., pid=6, masterSystemTime=1695798073048 2023-09-27 07:01:13,089 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:01:13,089 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:01:13,091 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=adea58e84d4895d882491dd24dce5c4e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:13,091 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1695798073090"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798073090"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798073090"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798073090"}]},"ts":"1695798073090"} 2023-09-27 07:01:13,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=6, resume processing ppid=5 2023-09-27 07:01:13,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure adea58e84d4895d882491dd24dce5c4e, server=jenkins-hbase4.apache.org,40331,1695798070393 in 201 msec 2023-09-27 07:01:13,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=5, resume processing ppid=4 2023-09-27 07:01:13,103 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=adea58e84d4895d882491dd24dce5c4e, ASSIGN in 374 msec 2023-09-27 07:01:13,104 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 07:01:13,105 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798073104"}]},"ts":"1695798073104"} 2023-09-27 07:01:13,107 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-09-27 07:01:13,111 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 07:01:13,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 567 msec 2023-09-27 07:01:13,158 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-09-27 07:01:13,160 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-09-27 07:01:13,160 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:01:13,183 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:13,185 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50724, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:13,203 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-09-27 07:01:13,224 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-27 07:01:13,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 40 msec 2023-09-27 07:01:13,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-09-27 07:01:13,248 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-09-27 07:01:13,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-09-27 07:01:13,263 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-09-27 07:01:13,266 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-09-27 07:01:13,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 2.803sec 2023-09-27 07:01:13,269 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-09-27 07:01:13,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-09-27 07:01:13,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-09-27 07:01:13,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41725,1695798069016-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-09-27 07:01:13,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41725,1695798069016-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-09-27 07:01:13,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-09-27 07:01:13,297 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1028): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-09-27 07:01:13,299 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 07:01:13,301 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 07:01:13,304 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b 2023-09-27 07:01:13,305 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b empty. 2023-09-27 07:01:13,305 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-09-27 07:01:13,310 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b 2023-09-27 07:01:13,310 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-09-27 07:01:13,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 07:01:13,329 DEBUG [Listener at localhost/43391] zookeeper.ReadOnlyZKClient(139): Connect 0x0cba4ac7 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:13,339 DEBUG [Listener at localhost/43391] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6315ad62, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:13,341 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-09-27 07:01:13,347 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => acfad5a895ba2ce613fab0e33e42ee5b, NAME => 'hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:01:13,361 DEBUG [hconnection-0x233759f6-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:13,376 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:13,377 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing acfad5a895ba2ce613fab0e33e42ee5b, disabling compactions & flushes 2023-09-27 07:01:13,377 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:01:13,377 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:01:13,377 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. after waiting 0 ms 2023-09-27 07:01:13,377 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:01:13,378 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:01:13,378 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for acfad5a895ba2ce613fab0e33e42ee5b: 2023-09-27 07:01:13,383 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:13,383 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 07:01:13,385 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695798073384"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798073384"}]},"ts":"1695798073384"} 2023-09-27 07:01:13,386 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41725,1695798069016 2023-09-27 07:01:13,386 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-09-27 07:01:13,386 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/test.cache.data in system properties and HBase conf 2023-09-27 07:01:13,386 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop.tmp.dir in system properties and HBase conf 2023-09-27 07:01:13,386 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop.log.dir in system properties and HBase conf 2023-09-27 07:01:13,386 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/mapreduce.cluster.local.dir in system properties and HBase conf 2023-09-27 07:01:13,386 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-09-27 07:01:13,386 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-09-27 07:01:13,386 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/nfs.dump.dir in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/java.io.tmpdir in system properties and HBase conf 2023-09-27 07:01:13,387 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/dfs.journalnode.edits.dir in system properties and HBase conf 2023-09-27 07:01:13,388 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-09-27 07:01:13,388 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-09-27 07:01:13,388 INFO [Listener at localhost/43391] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-09-27 07:01:13,389 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 07:01:13,389 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798073389"}]},"ts":"1695798073389"} 2023-09-27 07:01:13,392 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-09-27 07:01:13,397 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 07:01:13,398 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 07:01:13,398 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 07:01:13,398 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 07:01:13,398 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 07:01:13,398 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=acfad5a895ba2ce613fab0e33e42ee5b, ASSIGN}] 2023-09-27 07:01:13,401 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=acfad5a895ba2ce613fab0e33e42ee5b, ASSIGN 2023-09-27 07:01:13,403 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=acfad5a895ba2ce613fab0e33e42ee5b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40331,1695798070393; forceNewPlan=false, retain=false 2023-09-27 07:01:13,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 07:01:13,553 INFO [jenkins-hbase4:41725] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 07:01:13,554 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=acfad5a895ba2ce613fab0e33e42ee5b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:13,554 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695798073554"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798073554"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798073554"}]},"ts":"1695798073554"} 2023-09-27 07:01:13,558 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure acfad5a895ba2ce613fab0e33e42ee5b, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:01:13,622 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 07:01:13,718 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:01:13,719 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => acfad5a895ba2ce613fab0e33e42ee5b, NAME => 'hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b.', STARTKEY => '', ENDKEY => ''} 2023-09-27 07:01:13,719 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. service=AccessControlService 2023-09-27 07:01:13,719 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:13,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl acfad5a895ba2ce613fab0e33e42ee5b 2023-09-27 07:01:13,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:13,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for acfad5a895ba2ce613fab0e33e42ee5b 2023-09-27 07:01:13,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for acfad5a895ba2ce613fab0e33e42ee5b 2023-09-27 07:01:13,722 INFO [StoreOpener-acfad5a895ba2ce613fab0e33e42ee5b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region acfad5a895ba2ce613fab0e33e42ee5b 2023-09-27 07:01:13,725 DEBUG [StoreOpener-acfad5a895ba2ce613fab0e33e42ee5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b/l 2023-09-27 07:01:13,725 DEBUG [StoreOpener-acfad5a895ba2ce613fab0e33e42ee5b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b/l 2023-09-27 07:01:13,726 INFO [StoreOpener-acfad5a895ba2ce613fab0e33e42ee5b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region acfad5a895ba2ce613fab0e33e42ee5b columnFamilyName l 2023-09-27 07:01:13,727 INFO [StoreOpener-acfad5a895ba2ce613fab0e33e42ee5b-1] regionserver.HStore(310): Store=acfad5a895ba2ce613fab0e33e42ee5b/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:13,730 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b 2023-09-27 07:01:13,731 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b 2023-09-27 07:01:13,737 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for acfad5a895ba2ce613fab0e33e42ee5b 2023-09-27 07:01:13,741 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:01:13,743 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened acfad5a895ba2ce613fab0e33e42ee5b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70823351, jitterRate=0.0553501695394516}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:01:13,743 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for acfad5a895ba2ce613fab0e33e42ee5b: 2023-09-27 07:01:13,745 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b., pid=11, masterSystemTime=1695798073711 2023-09-27 07:01:13,748 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:01:13,748 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:01:13,750 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=acfad5a895ba2ce613fab0e33e42ee5b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:13,750 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1695798073750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798073750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798073750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798073750"}]},"ts":"1695798073750"} 2023-09-27 07:01:13,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=11, resume processing ppid=10 2023-09-27 07:01:13,761 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure acfad5a895ba2ce613fab0e33e42ee5b, server=jenkins-hbase4.apache.org,40331,1695798070393 in 196 msec 2023-09-27 07:01:13,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=10, resume processing ppid=9 2023-09-27 07:01:13,767 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=acfad5a895ba2ce613fab0e33e42ee5b, ASSIGN in 364 msec 2023-09-27 07:01:13,768 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 07:01:13,768 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798073768"}]},"ts":"1695798073768"} 2023-09-27 07:01:13,771 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-09-27 07:01:13,775 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 07:01:13,778 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 480 msec 2023-09-27 07:01:13,923 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-09-27 07:01:13,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-09-27 07:01:13,936 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-09-27 07:01:14,663 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 07:01:15,047 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 07:01:15,053 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_34651_jobhistory____.nn3u4m/webapp 2023-09-27 07:01:15,222 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-09-27 07:01:15,222 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-09-27 07:01:15,223 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 07:01:15,226 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 07:01:15,315 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:15,646 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:15,934 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-09-27 07:01:15,968 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:34651 2023-09-27 07:01:16,158 WARN [Listener at jenkins-hbase4.apache.org/41555] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 07:01:16,474 WARN [Listener at jenkins-hbase4.apache.org/41555] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 07:01:16,475 INFO [Listener at jenkins-hbase4.apache.org/41555] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 07:01:16,485 INFO [Listener at jenkins-hbase4.apache.org/41555] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40681_cluster____m1zitt/webapp 2023-09-27 07:01:16,564 INFO [Listener at jenkins-hbase4.apache.org/41555] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 07:01:16,564 INFO [Listener at jenkins-hbase4.apache.org/41555] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-09-27 07:01:16,564 INFO [Listener at jenkins-hbase4.apache.org/41555] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 07:01:16,565 INFO [Listener at jenkins-hbase4.apache.org/41555] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 07:01:16,576 INFO [Listener at jenkins-hbase4.apache.org/41555] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:16,770 INFO [Listener at jenkins-hbase4.apache.org/41555] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:16,858 INFO [Listener at jenkins-hbase4.apache.org/41555] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:16,865 INFO [Listener at jenkins-hbase4.apache.org/41555] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40681 2023-09-27 07:01:17,406 WARN [Listener at jenkins-hbase4.apache.org/45373] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 07:01:17,432 WARN [Listener at jenkins-hbase4.apache.org/45373] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 07:01:17,432 INFO [Listener at jenkins-hbase4.apache.org/45373] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 07:01:17,439 INFO [Listener at jenkins-hbase4.apache.org/45373] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45565_node____o3ca8h/webapp 2023-09-27 07:01:17,491 INFO [Listener at jenkins-hbase4.apache.org/45373] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-27 07:01:17,491 INFO [Listener at jenkins-hbase4.apache.org/45373] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 07:01:17,491 INFO [Listener at jenkins-hbase4.apache.org/45373] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 07:01:17,491 INFO [Listener at jenkins-hbase4.apache.org/45373] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 07:01:17,499 INFO [Listener at jenkins-hbase4.apache.org/45373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:17,520 INFO [Listener at jenkins-hbase4.apache.org/45373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:17,588 INFO [Listener at jenkins-hbase4.apache.org/45373] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:17,598 INFO [Listener at jenkins-hbase4.apache.org/45373] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45565 2023-09-27 07:01:17,770 WARN [Listener at jenkins-hbase4.apache.org/36133] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-09-27 07:01:17,779 WARN [Listener at jenkins-hbase4.apache.org/36133] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-09-27 07:01:17,780 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): jetty-6.1.26 2023-09-27 07:01:17,790 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_45769_node____.culi21/webapp 2023-09-27 07:01:17,857 INFO [Listener at jenkins-hbase4.apache.org/36133] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-09-27 07:01:17,858 INFO [Listener at jenkins-hbase4.apache.org/36133] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-09-27 07:01:17,858 INFO [Listener at jenkins-hbase4.apache.org/36133] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-09-27 07:01:17,858 INFO [Listener at jenkins-hbase4.apache.org/36133] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-09-27 07:01:17,865 INFO [Listener at jenkins-hbase4.apache.org/36133] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:17,868 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 07:01:17,910 INFO [Listener at jenkins-hbase4.apache.org/36133] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:18,042 INFO [Listener at jenkins-hbase4.apache.org/36133] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-09-27 07:01:18,055 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:45769 2023-09-27 07:01:18,084 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-09-27 07:01:18,086 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-09-27 07:01:18,087 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-09-27 07:01:18,095 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-09-27 07:01:18,096 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:01:18,164 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=705, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=165, AvailableMemoryMB=4521 2023-09-27 07:01:18,164 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=705 is superior to 500 2023-09-27 07:01:18,179 DEBUG [Listener at jenkins-hbase4.apache.org/36133] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-09-27 07:01:18,185 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-09-27 07:01:18,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 07:01:18,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-09-27 07:01:18,200 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 07:01:18,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-09-27 07:01:18,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 07:01:18,204 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 07:01:18,210 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:18,216 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67 empty. 2023-09-27 07:01:18,216 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:18,220 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:18,220 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d empty. 2023-09-27 07:01:18,221 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:18,221 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-27 07:01:18,253 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-09-27 07:01:18,255 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => ed728a5ee567106b84d79cc66c394c67, NAME => 'testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:01:18,255 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 2f07afcc91f610957f573c299fd1999d, NAME => 'testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:01:18,286 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:18,287 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 2f07afcc91f610957f573c299fd1999d, disabling compactions & flushes 2023-09-27 07:01:18,287 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:18,287 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:18,287 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. after waiting 0 ms 2023-09-27 07:01:18,287 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:18,287 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:18,287 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 2f07afcc91f610957f573c299fd1999d: 2023-09-27 07:01:18,288 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:18,289 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing ed728a5ee567106b84d79cc66c394c67, disabling compactions & flushes 2023-09-27 07:01:18,289 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:18,289 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:18,289 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. after waiting 0 ms 2023-09-27 07:01:18,289 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:18,289 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:18,289 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for ed728a5ee567106b84d79cc66c394c67: 2023-09-27 07:01:18,293 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 07:01:18,294 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695798078294"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798078294"}]},"ts":"1695798078294"} 2023-09-27 07:01:18,294 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695798078294"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798078294"}]},"ts":"1695798078294"} 2023-09-27 07:01:18,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 07:01:18,347 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 07:01:18,349 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 07:01:18,349 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798078349"}]},"ts":"1695798078349"} 2023-09-27 07:01:18,352 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-09-27 07:01:18,358 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 07:01:18,360 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 07:01:18,360 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 07:01:18,360 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 07:01:18,360 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 07:01:18,361 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ed728a5ee567106b84d79cc66c394c67, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f07afcc91f610957f573c299fd1999d, ASSIGN}] 2023-09-27 07:01:18,364 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f07afcc91f610957f573c299fd1999d, ASSIGN 2023-09-27 07:01:18,364 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ed728a5ee567106b84d79cc66c394c67, ASSIGN 2023-09-27 07:01:18,365 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ed728a5ee567106b84d79cc66c394c67, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33339,1695798070304; forceNewPlan=false, retain=false 2023-09-27 07:01:18,365 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f07afcc91f610957f573c299fd1999d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1695798070355; forceNewPlan=false, retain=false 2023-09-27 07:01:18,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 07:01:18,516 INFO [jenkins-hbase4:41725] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 07:01:18,518 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ed728a5ee567106b84d79cc66c394c67, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:18,518 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2f07afcc91f610957f573c299fd1999d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:18,518 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695798078518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798078518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798078518"}]},"ts":"1695798078518"} 2023-09-27 07:01:18,519 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695798078518"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798078518"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798078518"}]},"ts":"1695798078518"} 2023-09-27 07:01:18,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure ed728a5ee567106b84d79cc66c394c67, server=jenkins-hbase4.apache.org,33339,1695798070304}] 2023-09-27 07:01:18,522 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 2f07afcc91f610957f573c299fd1999d, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:01:18,677 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:18,677 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 07:01:18,682 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57870, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 07:01:18,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:18,686 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed728a5ee567106b84d79cc66c394c67, NAME => 'testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 07:01:18,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. service=AccessControlService 2023-09-27 07:01:18,687 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:18,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:18,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:18,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:18,687 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:18,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:18,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f07afcc91f610957f573c299fd1999d, NAME => 'testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 07:01:18,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. service=AccessControlService 2023-09-27 07:01:18,689 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:18,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:18,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:18,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:18,689 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:18,695 INFO [StoreOpener-2f07afcc91f610957f573c299fd1999d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:18,695 INFO [StoreOpener-ed728a5ee567106b84d79cc66c394c67-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:18,702 DEBUG [StoreOpener-2f07afcc91f610957f573c299fd1999d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/cf 2023-09-27 07:01:18,702 DEBUG [StoreOpener-2f07afcc91f610957f573c299fd1999d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/cf 2023-09-27 07:01:18,702 DEBUG [StoreOpener-ed728a5ee567106b84d79cc66c394c67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/cf 2023-09-27 07:01:18,702 DEBUG [StoreOpener-ed728a5ee567106b84d79cc66c394c67-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/cf 2023-09-27 07:01:18,705 INFO [StoreOpener-2f07afcc91f610957f573c299fd1999d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f07afcc91f610957f573c299fd1999d columnFamilyName cf 2023-09-27 07:01:18,705 INFO [StoreOpener-ed728a5ee567106b84d79cc66c394c67-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed728a5ee567106b84d79cc66c394c67 columnFamilyName cf 2023-09-27 07:01:18,710 INFO [StoreOpener-2f07afcc91f610957f573c299fd1999d-1] regionserver.HStore(310): Store=2f07afcc91f610957f573c299fd1999d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:18,712 INFO [StoreOpener-ed728a5ee567106b84d79cc66c394c67-1] regionserver.HStore(310): Store=ed728a5ee567106b84d79cc66c394c67/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:18,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:18,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:18,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:18,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:18,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:18,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:18,733 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:01:18,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:01:18,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ed728a5ee567106b84d79cc66c394c67; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74455036, jitterRate=0.10946649312973022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:01:18,734 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ed728a5ee567106b84d79cc66c394c67: 2023-09-27 07:01:18,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2f07afcc91f610957f573c299fd1999d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71459593, jitterRate=0.06483091413974762}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:01:18,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2f07afcc91f610957f573c299fd1999d: 2023-09-27 07:01:18,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67., pid=15, masterSystemTime=1695798078674 2023-09-27 07:01:18,736 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d., pid=16, masterSystemTime=1695798078677 2023-09-27 07:01:18,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:18,742 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:18,743 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=2f07afcc91f610957f573c299fd1999d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:18,743 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695798078742"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798078742"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798078742"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798078742"}]},"ts":"1695798078742"} 2023-09-27 07:01:18,743 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:18,743 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:18,745 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ed728a5ee567106b84d79cc66c394c67, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:18,746 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695798078745"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798078745"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798078745"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798078745"}]},"ts":"1695798078745"} 2023-09-27 07:01:18,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=16, resume processing ppid=14 2023-09-27 07:01:18,750 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 2f07afcc91f610957f573c299fd1999d, server=jenkins-hbase4.apache.org,43767,1695798070355 in 225 msec 2023-09-27 07:01:18,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=15, resume processing ppid=13 2023-09-27 07:01:18,754 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f07afcc91f610957f573c299fd1999d, ASSIGN in 389 msec 2023-09-27 07:01:18,754 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure ed728a5ee567106b84d79cc66c394c67, server=jenkins-hbase4.apache.org,33339,1695798070304 in 228 msec 2023-09-27 07:01:18,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=13, resume processing ppid=12 2023-09-27 07:01:18,758 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ed728a5ee567106b84d79cc66c394c67, ASSIGN in 393 msec 2023-09-27 07:01:18,759 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 07:01:18,759 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798078759"}]},"ts":"1695798078759"} 2023-09-27 07:01:18,762 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-09-27 07:01:18,765 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 07:01:18,770 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-09-27 07:01:18,780 DEBUG [hconnection-0x683814fc-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:18,784 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-09-27 07:01:18,792 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 07:01:18,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 07:01:18,824 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:18,824 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:18,824 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:18,824 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:18,824 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:18,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:18,835 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 636 msec 2023-09-27 07:01:19,192 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:01:19,193 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-09-27 07:01:19,193 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:01:19,193 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-09-27 07:01:19,193 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-27 07:01:19,193 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-09-27 07:01:19,194 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:01:19,194 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-09-27 07:01:19,194 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-27 07:01:19,194 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-09-27 07:01:19,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-09-27 07:01:19,312 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-09-27 07:01:19,316 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-27 07:01:19,317 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:19,320 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:01:19,346 DEBUG [hconnection-0x233759f6-shared-pool-5] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:19,351 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:19,366 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 07:01:19,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798079366 (current time:1695798079366). 2023-09-27 07:01:19,366 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:01:19,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x0514784f to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:19,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@10c63fdf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:19,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:19,378 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52634, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:19,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0514784f to 127.0.0.1:53388 2023-09-27 07:01:19,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:19,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x1133855d to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:19,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4fbd9157, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:19,391 DEBUG [hconnection-0xce20c7c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:19,392 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:19,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:19,398 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:19,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1133855d to 127.0.0.1:53388 2023-09-27 07:01:19,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:19,400 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 07:01:19,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:01:19,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 07:01:19,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 07:01:19,446 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 07:01:19,447 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695798679447 2023-09-27 07:01:19,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 07:01:19,447 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-27 07:01:19,451 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 07:01:19,452 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 07:01:19,455 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:01:19,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 15 msec 2023-09-27 07:01:19,456 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:01:19,457 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 07:01:19,458 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695798679458 2023-09-27 07:01:19,489 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,489 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-09-27 07:01:19,489 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:19,490 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-09-27 07:01:19,490 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-27 07:01:19,491 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,491 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,496 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:19,496 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:19,496 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:19,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:19,496 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,496 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:19,497 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:19,497 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,497 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,498 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,498 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:01:19,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,498 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 07:01:19,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 07:01:19,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-09-27 07:01:19,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 07:01:19,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 07:01:19,500 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 07:01:19,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,503 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,507 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 07:01:19,507 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:19,507 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 07:01:19,508 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 07:01:19,508 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:19,508 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:19,508 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 07:01:19,510 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 07:01:19,510 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 07:01:19,509 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 07:01:19,510 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 07:01:19,510 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 07:01:19,510 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 07:01:19,510 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-09-27 07:01:19,510 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-09-27 07:01:19,513 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,513 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,513 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:19,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:19,514 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,514 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,514 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,514 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:19,514 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,514 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:19,514 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,515 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:19,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:19,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-27 07:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1956ffc[Count = 1] remaining members to acquire global barrier 2023-09-27 07:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:19,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:19,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:19,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:19,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-09-27 07:01:19,522 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1956ffc[Count = 0] remaining members to acquire global barrier 2023-09-27 07:01:19,522 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-27 07:01:19,522 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,525 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,525 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,525 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 07:01:19,525 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,525 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 07:01:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 07:01:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 07:01:19,525 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:01:19,526 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,526 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:01:19,526 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:19,526 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:19,526 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:19,527 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. started... 2023-09-27 07:01:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:19,529 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:19,529 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed728a5ee567106b84d79cc66c394c67: 2023-09-27 07:01:19,529 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. started... 2023-09-27 07:01:19,529 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:19,531 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f07afcc91f610957f573c299fd1999d: 2023-09-27 07:01:19,532 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,532 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,535 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 07:01:19,535 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:19,535 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 07:01:19,539 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:19,539 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:19,543 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:01:19,543 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:01:19,557 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:19,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 07:01:19,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:01:19,568 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:01:19,596 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. completed. 2023-09-27 07:01:19,597 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:19,597 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. completed. 2023-09-27 07:01:19,597 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 07:01:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-09-27 07:01:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:01:19,598 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:01:19,601 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,601 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 07:01:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:19,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:19,601 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:19,601 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,601 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 07:01:19,601 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 07:01:19,602 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:19,602 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-09-27 07:01:19,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:19,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33339,1695798070304': 2023-09-27 07:01:19,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-27 07:01:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:19,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:19,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:19,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:19,609 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,610 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:19,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:01:19,613 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-27 07:01:19,613 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-09-27 07:01:19,613 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:01:19,613 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:01:19,613 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,613 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:01:19,616 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:19,616 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:19,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:19,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:19,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:19,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:19,617 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:19,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:19,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:19,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:19,617 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,617 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:19,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:19,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,618 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:19,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,620 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:19,620 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,621 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,634 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,634 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:19,634 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:19,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:19,634 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,634 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:19,634 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:19,634 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:19,634 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:19,634 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:19,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:19,635 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-27 07:01:19,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:19,634 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:19,634 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,635 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:19,635 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,635 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,635 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:19,635 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:19,636 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:01:19,636 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:19,636 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:19,636 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:19,636 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:19,636 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,636 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,636 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:19,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 07:01:19,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,713 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-27 07:01:19,714 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,714 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:19,716 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695798079448Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695798079654 (+206 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1695798079655 (+1 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1695798079655Writing data manifest for emptySnaptb0-testExportWithTargetName at 1695798079669 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1695798079699 (+30 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695798079713 (+14 ms) 2023-09-27 07:01:19,717 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 07:01:19,720 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 268 msec 2023-09-27 07:01:19,770 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:19,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 07:01:19,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:01:19,794 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33339] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:01:19,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:01:19,802 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-09-27 07:01:19,802 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:19,802 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:01:19,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 07:01:19,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798079819 (current time:1695798079819). 2023-09-27 07:01:19,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:01:19,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x588144e5 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:19,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3344727a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:19,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:19,832 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:19,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x588144e5 to 127.0.0.1:53388 2023-09-27 07:01:19,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:19,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x6582a0fe to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:19,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@37f666c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:19,842 DEBUG [hconnection-0x27b105e1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:19,845 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52666, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:19,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:19,851 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56794, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:19,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6582a0fe to 127.0.0.1:53388 2023-09-27 07:01:19,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:19,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-09-27 07:01:19,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:01:19,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 07:01:19,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 07:01:19,859 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 07:01:19,860 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1695798679860 2023-09-27 07:01:19,860 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-09-27 07:01:19,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-09-27 07:01:19,862 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:01:19,862 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:01:19,862 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 07:01:19,863 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-09-27 07:01:19,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-09-27 07:01:19,866 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 07:01:19,867 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1695798679867 2023-09-27 07:01:19,883 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-09-27 07:01:19,883 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-09-27 07:01:19,883 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:19,884 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-09-27 07:01:19,884 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-09-27 07:01:19,885 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,885 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,887 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:19,887 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,887 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:19,887 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:19,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:19,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:19,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:19,887 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:19,887 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,888 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,888 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:01:19,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 07:01:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 07:01:19,889 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-09-27 07:01:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 07:01:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-09-27 07:01:19,890 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:19,889 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:19,891 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 07:01:19,892 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 07:01:19,892 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 07:01:19,892 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 07:01:19,890 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:19,892 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 07:01:19,892 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 07:01:19,893 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-09-27 07:01:19,893 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-09-27 07:01:19,893 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-09-27 07:01:19,896 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,896 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:19,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:19,897 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,897 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,897 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:19,897 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,897 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,898 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:19,898 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:19,898 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,898 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:19,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 07:01:19,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:19,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-27 07:01:19,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21714d8[Count = 1] remaining members to acquire global barrier 2023-09-27 07:01:19,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:19,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:19,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:19,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:19,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 07:01:19,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:19,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:19,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-09-27 07:01:19,905 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@21714d8[Count = 0] remaining members to acquire global barrier 2023-09-27 07:01:19,905 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-09-27 07:01:19,905 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,909 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,909 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,909 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,910 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 07:01:19,910 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 07:01:19,910 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:19,910 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,910 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:19,910 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:19,910 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:19,910 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. started... 2023-09-27 07:01:19,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:19,910 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:19,910 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:19,910 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ed728a5ee567106b84d79cc66c394c67 1/1 column families, dataSize=65 B heapSize=400 B 2023-09-27 07:01:19,910 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. started... 2023-09-27 07:01:19,910 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-09-27 07:01:19,910 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:19,910 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 07:01:19,911 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2f07afcc91f610957f573c299fd1999d 1/1 column families, dataSize=3.19 KB heapSize=7.14 KB 2023-09-27 07:01:19,910 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:19,911 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:01:19,911 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:01:19,914 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 07:01:19,914 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:19,914 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 07:01:19,962 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:19,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 07:01:19,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:01:19,964 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:01:20,051 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023092796e3a6352e7a4807b94fe93dbfde0ec0 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092796e3a6352e7a4807b94fe93dbfde0ec0 2023-09-27 07:01:20,051 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927c1bd9ac01ecd49f5bb75395e0adb9274 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927c1bd9ac01ecd49f5bb75395e0adb9274 2023-09-27 07:01:20,089 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.2 K, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/.tmp/cf/a90120b899ce4a91930b0112a93f15e6 2023-09-27 07:01:20,090 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=65, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/.tmp/cf/98f436aa2c3f433f951ba2288178bafa 2023-09-27 07:01:20,101 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/.tmp/cf/98f436aa2c3f433f951ba2288178bafa as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/cf/98f436aa2c3f433f951ba2288178bafa 2023-09-27 07:01:20,107 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/.tmp/cf/a90120b899ce4a91930b0112a93f15e6 as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/cf/a90120b899ce4a91930b0112a93f15e6 2023-09-27 07:01:20,111 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/cf/98f436aa2c3f433f951ba2288178bafa, entries=1, sequenceid=6, filesize=5.1 K 2023-09-27 07:01:20,114 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~65 B/65, heapSize ~384 B/384, currentSize=0 B/0 for ed728a5ee567106b84d79cc66c394c67 in 204ms, sequenceid=6, compaction requested=false 2023-09-27 07:01:20,115 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-09-27 07:01:20,115 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed728a5ee567106b84d79cc66c394c67: 2023-09-27 07:01:20,116 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 07:01:20,116 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:20,116 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/cf/98f436aa2c3f433f951ba2288178bafa] hfiles 2023-09-27 07:01:20,116 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/cf/98f436aa2c3f433f951ba2288178bafa for snapshot=snaptb0-testExportWithTargetName 2023-09-27 07:01:20,117 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/cf/a90120b899ce4a91930b0112a93f15e6, entries=49, sequenceid=6, filesize=13.1 K 2023-09-27 07:01:20,120 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.19 KB/3271, heapSize ~7.13 KB/7296, currentSize=0 B/0 for 2f07afcc91f610957f573c299fd1999d in 209ms, sequenceid=6, compaction requested=false 2023-09-27 07:01:20,122 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f07afcc91f610957f573c299fd1999d: 2023-09-27 07:01:20,122 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 07:01:20,122 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:20,122 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/cf/a90120b899ce4a91930b0112a93f15e6] hfiles 2023-09-27 07:01:20,122 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/cf/a90120b899ce4a91930b0112a93f15e6 for snapshot=snaptb0-testExportWithTargetName 2023-09-27 07:01:20,141 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. completed. 2023-09-27 07:01:20,141 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:20,141 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:20,141 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:20,141 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,141 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 07:01:20,142 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:01:20,145 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 07:01:20,145 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,145 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:20,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:20,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:20,145 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 07:01:20,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:20,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:20,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 07:01:20,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,150 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. completed. 2023-09-27 07:01:20,150 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-09-27 07:01:20,150 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:01:20,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:20,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 07:01:20,152 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-09-27 07:01:20,152 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,152 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:20,152 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:20,152 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-09-27 07:01:20,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:01:20,155 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-09-27 07:01:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:20,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 07:01:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:20,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:20,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 07:01:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,33339,1695798070304': 2023-09-27 07:01:20,159 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-09-27 07:01:20,159 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-09-27 07:01:20,159 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:01:20,159 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:01:20,159 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-09-27 07:01:20,159 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:01:20,164 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:20,165 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,165 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,166 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:20,165 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,165 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 07:01:20,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:01:20,166 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,166 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:20,167 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:20,166 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:20,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:20,166 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 07:01:20,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:20,167 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,167 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:20,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:20,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:20,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,167 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:20,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 07:01:20,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:20,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 07:01:20,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:20,170 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:20,170 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,170 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,171 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:20,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-09-27 07:01:20,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:20,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,182 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,182 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,182 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:20,182 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:20,182 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:20,183 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-09-27 07:01:20,182 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:20,183 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName because node does not exist (not an error) 2023-09-27 07:01:20,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:20,183 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-09-27 07:01:20,183 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:20,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:20,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-09-27 07:01:20,183 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:20,183 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:01:20,183 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:20,182 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:20,184 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,184 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:20,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:20,183 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:20,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:20,184 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:20,185 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,185 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:20,185 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:20,185 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,185 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:20,185 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:20,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:20,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092796e3a6352e7a4807b94fe93dbfde0ec0, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927c1bd9ac01ecd49f5bb75395e0adb9274] mob files 2023-09-27 07:01:20,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092796e3a6352e7a4807b94fe93dbfde0ec0 2023-09-27 07:01:20,186 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927c1bd9ac01ecd49f5bb75395e0adb9274 2023-09-27 07:01:20,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-09-27 07:01:20,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,246 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,247 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-09-27 07:01:20,247 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,248 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-09-27 07:01:20,248 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1695798079860Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1695798080203 (+343 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1695798080203Loading Region manifests for snaptb0-testExportWithTargetName at 1695798080203Writing data manifest for snaptb0-testExportWithTargetName at 1695798080210 (+7 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1695798080234 (+24 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1695798080247 (+13 ms) 2023-09-27 07:01:20,250 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-09-27 07:01:20,253 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 390 msec 2023-09-27 07:01:20,467 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:20,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-09-27 07:01:20,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:01:20,471 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798080471 2023-09-27 07:01:20,472 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35855, tgtDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798080471, rawTgtDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798080471, srcFsUri=hdfs://localhost:35855, srcDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:01:20,514 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:01:20,514 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2052034312_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798080471, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798080471/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-27 07:01:20,514 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18, snapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-09-27 07:01:20,535 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798080471/.hbase-snapshot/.tmp/testExportWithTargetName 2023-09-27 07:01:20,613 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:20,614 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:20,615 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:20,615 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:21,550 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-1063604992857784740.jar 2023-09-27 07:01:21,551 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:21,551 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:21,621 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-2744192385812150517.jar 2023-09-27 07:01:21,621 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:21,622 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:21,622 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:21,623 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:21,623 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:21,624 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:21,624 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 07:01:21,624 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 07:01:21,625 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 07:01:21,625 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 07:01:21,626 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 07:01:21,626 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 07:01:21,627 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 07:01:21,627 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 07:01:21,627 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 07:01:21,628 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 07:01:21,632 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:21,633 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:21,633 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:01:21,634 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:21,634 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:21,635 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:01:21,635 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:01:22,504 WARN [Listener at jenkins-hbase4.apache.org/36133] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 07:01:22,511 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-09-27 07:01:22,519 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-27 07:01:22,984 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:01:22,986 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:01:23,253 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0001_000001 (auth:SIMPLE) 2023-09-27 07:01:24,193 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 07:01:27,603 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0001_000001 (auth:SIMPLE) 2023-09-27 07:01:29,873 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0001_000001 (auth:SIMPLE) 2023-09-27 07:01:33,304 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0001_000001 (auth:SIMPLE) 2023-09-27 07:01:35,427 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 07:01:35,430 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 07:01:35,441 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-09-27 07:01:35,441 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 07:01:35,442 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 07:01:35,442 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-09-27 07:01:35,443 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-09-27 07:01:35,443 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-09-27 07:01:35,443 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798080471/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798080471/.hbase-snapshot/testExportWithTargetName 2023-09-27 07:01:35,444 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798080471/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-09-27 07:01:35,444 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798080471/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-09-27 07:01:35,455 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-09-27 07:01:35,461 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-09-27 07:01:35,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-09-27 07:01:35,474 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798095474"}]},"ts":"1695798095474"} 2023-09-27 07:01:35,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 07:01:35,476 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-09-27 07:01:35,478 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-09-27 07:01:35,480 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ed728a5ee567106b84d79cc66c394c67, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f07afcc91f610957f573c299fd1999d, UNASSIGN}] 2023-09-27 07:01:35,482 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ed728a5ee567106b84d79cc66c394c67, UNASSIGN 2023-09-27 07:01:35,482 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f07afcc91f610957f573c299fd1999d, UNASSIGN 2023-09-27 07:01:35,483 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ed728a5ee567106b84d79cc66c394c67, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:35,483 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2f07afcc91f610957f573c299fd1999d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:35,483 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695798095483"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798095483"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798095483"}]},"ts":"1695798095483"} 2023-09-27 07:01:35,483 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695798095483"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798095483"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798095483"}]},"ts":"1695798095483"} 2023-09-27 07:01:35,485 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure ed728a5ee567106b84d79cc66c394c67, server=jenkins-hbase4.apache.org,33339,1695798070304}] 2023-09-27 07:01:35,486 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 2f07afcc91f610957f573c299fd1999d, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:01:35,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 07:01:35,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:35,646 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:35,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2f07afcc91f610957f573c299fd1999d, disabling compactions & flushes 2023-09-27 07:01:35,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ed728a5ee567106b84d79cc66c394c67, disabling compactions & flushes 2023-09-27 07:01:35,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:35,647 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:35,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:35,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:35,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. after waiting 0 ms 2023-09-27 07:01:35,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. after waiting 0 ms 2023-09-27 07:01:35,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:35,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:35,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:01:35,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:01:35,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:01:35,665 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:01:35,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67. 2023-09-27 07:01:35,666 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d. 2023-09-27 07:01:35,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ed728a5ee567106b84d79cc66c394c67: 2023-09-27 07:01:35,667 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2f07afcc91f610957f573c299fd1999d: 2023-09-27 07:01:35,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:35,670 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=ed728a5ee567106b84d79cc66c394c67, regionState=CLOSED 2023-09-27 07:01:35,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:35,670 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695798095670"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798095670"}]},"ts":"1695798095670"} 2023-09-27 07:01:35,671 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=2f07afcc91f610957f573c299fd1999d, regionState=CLOSED 2023-09-27 07:01:35,671 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1695798095671"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798095671"}]},"ts":"1695798095671"} 2023-09-27 07:01:35,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=24, resume processing ppid=22 2023-09-27 07:01:35,675 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure ed728a5ee567106b84d79cc66c394c67, server=jenkins-hbase4.apache.org,33339,1695798070304 in 187 msec 2023-09-27 07:01:35,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=25, resume processing ppid=23 2023-09-27 07:01:35,676 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 2f07afcc91f610957f573c299fd1999d, server=jenkins-hbase4.apache.org,43767,1695798070355 in 188 msec 2023-09-27 07:01:35,677 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=ed728a5ee567106b84d79cc66c394c67, UNASSIGN in 195 msec 2023-09-27 07:01:35,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=23, resume processing ppid=21 2023-09-27 07:01:35,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=2f07afcc91f610957f573c299fd1999d, UNASSIGN in 196 msec 2023-09-27 07:01:35,680 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798095680"}]},"ts":"1695798095680"} 2023-09-27 07:01:35,682 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-09-27 07:01:35,684 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-09-27 07:01:35,686 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 221 msec 2023-09-27 07:01:35,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-09-27 07:01:35,779 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-09-27 07:01:35,783 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-09-27 07:01:35,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 07:01:35,794 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 07:01:35,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-09-27 07:01:35,796 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 07:01:35,799 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-09-27 07:01:35,802 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:35,802 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 07:01:35,802 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 07:01:35,803 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:35,803 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 07:01:35,803 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 07:01:35,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-27 07:01:35,804 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-09-27 07:01:35,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:35,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 07:01:35,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-09-27 07:01:35,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:35,805 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-27 07:01:35,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:35,805 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 07:01:35,806 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-09-27 07:01:35,806 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 07:01:35,806 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:35,807 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/recovered.edits] 2023-09-27 07:01:35,807 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/recovered.edits] 2023-09-27 07:01:35,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-27 07:01:35,816 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/cf/a90120b899ce4a91930b0112a93f15e6 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/cf/a90120b899ce4a91930b0112a93f15e6 2023-09-27 07:01:35,816 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/cf/98f436aa2c3f433f951ba2288178bafa to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/cf/98f436aa2c3f433f951ba2288178bafa 2023-09-27 07:01:35,820 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67/recovered.edits/9.seqid 2023-09-27 07:01:35,820 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d/recovered.edits/9.seqid 2023-09-27 07:01:35,821 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/ed728a5ee567106b84d79cc66c394c67 2023-09-27 07:01:35,821 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportWithTargetName/2f07afcc91f610957f573c299fd1999d 2023-09-27 07:01:35,821 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-09-27 07:01:35,822 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-27 07:01:35,823 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-09-27 07:01:35,827 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092796e3a6352e7a4807b94fe93dbfde0ec0 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b2023092796e3a6352e7a4807b94fe93dbfde0ec0 2023-09-27 07:01:35,828 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927c1bd9ac01ecd49f5bb75395e0adb9274 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e20230927c1bd9ac01ecd49f5bb75395e0adb9274 2023-09-27 07:01:35,829 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-09-27 07:01:35,832 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 07:01:35,854 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-09-27 07:01:35,857 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-09-27 07:01:35,859 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 07:01:35,859 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-09-27 07:01:35,859 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798095859"}]},"ts":"9223372036854775807"} 2023-09-27 07:01:35,859 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798095859"}]},"ts":"9223372036854775807"} 2023-09-27 07:01:35,862 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 07:01:35,862 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ed728a5ee567106b84d79cc66c394c67, NAME => 'testtb-testExportWithTargetName,,1695798078194.ed728a5ee567106b84d79cc66c394c67.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 2f07afcc91f610957f573c299fd1999d, NAME => 'testtb-testExportWithTargetName,1,1695798078194.2f07afcc91f610957f573c299fd1999d.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 07:01:35,862 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-09-27 07:01:35,862 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695798095862"}]},"ts":"9223372036854775807"} 2023-09-27 07:01:35,865 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-09-27 07:01:35,867 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-09-27 07:01:35,869 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 82 msec 2023-09-27 07:01:35,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-09-27 07:01:35,913 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-09-27 07:01:35,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-09-27 07:01:35,934 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-09-27 07:01:35,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-09-27 07:01:35,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-09-27 07:01:35,972 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=755 (was 705) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-2 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:40232 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:45373 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1286 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1272412237_1 at /127.0.0.1:50910 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1272412237_1 at /127.0.0.1:42268 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:38077 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:52700 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-876958994_17 at /127.0.0.1:36632 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:41455 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 202) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=3686 (was 4521) 2023-09-27 07:01:35,972 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-27 07:01:35,995 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=168, AvailableMemoryMB=3686 2023-09-27 07:01:35,995 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-09-27 07:01:35,998 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 07:01:36,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-09-27 07:01:36,005 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 07:01:36,006 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-09-27 07:01:36,007 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 07:01:36,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 07:01:36,010 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:36,010 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:36,011 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8 empty. 2023-09-27 07:01:36,011 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac empty. 2023-09-27 07:01:36,011 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:36,011 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:36,011 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-27 07:01:36,024 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-27 07:01:36,025 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6bac4bc81d183f608d93985d2cc08ce8, NAME => 'testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:01:36,025 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => c3d684b5917f27d9ea4f687bb8d7eeac, NAME => 'testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:01:36,048 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:36,050 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6bac4bc81d183f608d93985d2cc08ce8, disabling compactions & flushes 2023-09-27 07:01:36,050 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:36,050 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:36,050 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. after waiting 0 ms 2023-09-27 07:01:36,050 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:36,050 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:36,050 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6bac4bc81d183f608d93985d2cc08ce8: 2023-09-27 07:01:36,052 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:36,053 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing c3d684b5917f27d9ea4f687bb8d7eeac, disabling compactions & flushes 2023-09-27 07:01:36,053 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:36,054 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:36,054 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. after waiting 0 ms 2023-09-27 07:01:36,054 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:36,054 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:36,054 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for c3d684b5917f27d9ea4f687bb8d7eeac: 2023-09-27 07:01:36,057 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 07:01:36,058 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695798096058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798096058"}]},"ts":"1695798096058"} 2023-09-27 07:01:36,058 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695798096058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798096058"}]},"ts":"1695798096058"} 2023-09-27 07:01:36,060 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 07:01:36,062 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 07:01:36,062 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798096062"}]},"ts":"1695798096062"} 2023-09-27 07:01:36,063 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-09-27 07:01:36,067 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 07:01:36,069 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 07:01:36,069 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 07:01:36,069 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 07:01:36,069 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 07:01:36,069 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6bac4bc81d183f608d93985d2cc08ce8, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3d684b5917f27d9ea4f687bb8d7eeac, ASSIGN}] 2023-09-27 07:01:36,072 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6bac4bc81d183f608d93985d2cc08ce8, ASSIGN 2023-09-27 07:01:36,072 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3d684b5917f27d9ea4f687bb8d7eeac, ASSIGN 2023-09-27 07:01:36,073 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6bac4bc81d183f608d93985d2cc08ce8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40331,1695798070393; forceNewPlan=false, retain=false 2023-09-27 07:01:36,073 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3d684b5917f27d9ea4f687bb8d7eeac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1695798070355; forceNewPlan=false, retain=false 2023-09-27 07:01:36,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 07:01:36,223 INFO [jenkins-hbase4:41725] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 07:01:36,226 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c3d684b5917f27d9ea4f687bb8d7eeac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,226 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6bac4bc81d183f608d93985d2cc08ce8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,226 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695798096226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798096226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798096226"}]},"ts":"1695798096226"} 2023-09-27 07:01:36,227 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695798096226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798096226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798096226"}]},"ts":"1695798096226"} 2023-09-27 07:01:36,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure c3d684b5917f27d9ea4f687bb8d7eeac, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:01:36,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure 6bac4bc81d183f608d93985d2cc08ce8, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:01:36,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 07:01:36,390 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:36,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c3d684b5917f27d9ea4f687bb8d7eeac, NAME => 'testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 07:01:36,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. service=AccessControlService 2023-09-27 07:01:36,391 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:36,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:36,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:36,391 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:36,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:36,392 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:36,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6bac4bc81d183f608d93985d2cc08ce8, NAME => 'testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 07:01:36,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. service=AccessControlService 2023-09-27 07:01:36,393 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:36,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:36,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:36,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:36,393 INFO [StoreOpener-c3d684b5917f27d9ea4f687bb8d7eeac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:36,393 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:36,395 INFO [StoreOpener-6bac4bc81d183f608d93985d2cc08ce8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:36,395 DEBUG [StoreOpener-c3d684b5917f27d9ea4f687bb8d7eeac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/cf 2023-09-27 07:01:36,395 DEBUG [StoreOpener-c3d684b5917f27d9ea4f687bb8d7eeac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/cf 2023-09-27 07:01:36,395 INFO [StoreOpener-c3d684b5917f27d9ea4f687bb8d7eeac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c3d684b5917f27d9ea4f687bb8d7eeac columnFamilyName cf 2023-09-27 07:01:36,396 DEBUG [StoreOpener-6bac4bc81d183f608d93985d2cc08ce8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/cf 2023-09-27 07:01:36,396 DEBUG [StoreOpener-6bac4bc81d183f608d93985d2cc08ce8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/cf 2023-09-27 07:01:36,397 INFO [StoreOpener-6bac4bc81d183f608d93985d2cc08ce8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6bac4bc81d183f608d93985d2cc08ce8 columnFamilyName cf 2023-09-27 07:01:36,397 INFO [StoreOpener-c3d684b5917f27d9ea4f687bb8d7eeac-1] regionserver.HStore(310): Store=c3d684b5917f27d9ea4f687bb8d7eeac/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:36,399 INFO [StoreOpener-6bac4bc81d183f608d93985d2cc08ce8-1] regionserver.HStore(310): Store=6bac4bc81d183f608d93985d2cc08ce8/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:36,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:36,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:36,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:36,402 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:36,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:36,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:36,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:01:36,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:01:36,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c3d684b5917f27d9ea4f687bb8d7eeac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68383334, jitterRate=0.018991082906723022}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:01:36,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c3d684b5917f27d9ea4f687bb8d7eeac: 2023-09-27 07:01:36,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6bac4bc81d183f608d93985d2cc08ce8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62002213, jitterRate=-0.07609502971172333}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:01:36,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6bac4bc81d183f608d93985d2cc08ce8: 2023-09-27 07:01:36,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8., pid=31, masterSystemTime=1695798096383 2023-09-27 07:01:36,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac., pid=30, masterSystemTime=1695798096382 2023-09-27 07:01:36,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:36,414 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:36,415 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6bac4bc81d183f608d93985d2cc08ce8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:36,415 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695798096414"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798096414"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798096414"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798096414"}]},"ts":"1695798096414"} 2023-09-27 07:01:36,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:36,416 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=c3d684b5917f27d9ea4f687bb8d7eeac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,418 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695798096416"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798096416"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798096416"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798096416"}]},"ts":"1695798096416"} 2023-09-27 07:01:36,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=31, resume processing ppid=28 2023-09-27 07:01:36,423 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure 6bac4bc81d183f608d93985d2cc08ce8, server=jenkins-hbase4.apache.org,40331,1695798070393 in 188 msec 2023-09-27 07:01:36,427 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6bac4bc81d183f608d93985d2cc08ce8, ASSIGN in 354 msec 2023-09-27 07:01:36,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=30, resume processing ppid=29 2023-09-27 07:01:36,433 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure c3d684b5917f27d9ea4f687bb8d7eeac, server=jenkins-hbase4.apache.org,43767,1695798070355 in 194 msec 2023-09-27 07:01:36,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=29, resume processing ppid=27 2023-09-27 07:01:36,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3d684b5917f27d9ea4f687bb8d7eeac, ASSIGN in 364 msec 2023-09-27 07:01:36,437 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 07:01:36,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798096437"}]},"ts":"1695798096437"} 2023-09-27 07:01:36,440 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-09-27 07:01:36,443 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 07:01:36,443 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-09-27 07:01:36,446 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 07:01:36,447 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:36,447 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:36,447 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:36,447 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:36,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:36,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:36,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:36,449 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:36,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 449 msec 2023-09-27 07:01:36,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-09-27 07:01:36,613 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-09-27 07:01:36,616 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-27 07:01:36,616 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:36,620 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:01:36,631 DEBUG [hconnection-0x233759f6-shared-pool-10] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:36,638 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59878, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:36,645 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:01:36,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798096645 (current time:1695798096645). 2023-09-27 07:01:36,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:01:36,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x7f991971 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:36,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@72159c35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:36,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:36,659 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:36,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7f991971 to 127.0.0.1:53388 2023-09-27 07:01:36,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:36,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x3bfc0a61 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:36,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@c19defe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:36,673 DEBUG [hconnection-0x52331f7c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:36,677 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40516, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:36,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:36,684 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:36,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3bfc0a61 to 127.0.0.1:53388 2023-09-27 07:01:36,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:36,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 07:01:36,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:01:36,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:01:36,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:01:36,696 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:01:36,697 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695798696697 2023-09-27 07:01:36,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:01:36,697 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-27 07:01:36,699 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:01:36,699 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:01:36,700 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 07:01:36,702 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:01:36,704 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 13 msec 2023-09-27 07:01:36,705 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 07:01:36,706 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695798696706 2023-09-27 07:01:36,726 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,726 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-09-27 07:01:36,726 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:36,728 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-09-27 07:01:36,728 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-27 07:01:36,728 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,728 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,730 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:36,730 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:36,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:36,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:36,730 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:36,730 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:36,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,731 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,731 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,731 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,732 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,732 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,733 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,733 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 07:01:36,733 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 07:01:36,733 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:36,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,734 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 07:01:36,734 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 07:01:36,733 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:36,734 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 07:01:36,734 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 07:01:36,735 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 07:01:36,736 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 07:01:36,736 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,736 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 07:01:36,736 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 07:01:36,736 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:36,737 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 07:01:36,737 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-09-27 07:01:36,737 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-09-27 07:01:36,738 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,738 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:36,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,746 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:36,746 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,747 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:36,747 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,747 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:36,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:36,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:36,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-27 07:01:36,748 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a8100dd[Count = 1] remaining members to acquire global barrier 2023-09-27 07:01:36,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:36,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:36,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-09-27 07:01:36,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a8100dd[Count = 0] remaining members to acquire global barrier 2023-09-27 07:01:36,751 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 07:01:36,751 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,752 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,752 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,752 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,752 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:01:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,752 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,752 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:01:36,752 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:01:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 07:01:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:36,753 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:36,753 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,753 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. started... 2023-09-27 07:01:36,753 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:36,753 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. started... 2023-09-27 07:01:36,753 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6bac4bc81d183f608d93985d2cc08ce8: 2023-09-27 07:01:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:01:36,753 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:36,753 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:01:36,755 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,755 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3d684b5917f27d9ea4f687bb8d7eeac: 2023-09-27 07:01:36,755 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:36,755 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:01:36,755 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,755 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:36,755 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:01:36,756 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 07:01:36,756 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:36,756 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 07:01:36,779 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. completed. 2023-09-27 07:01:36,779 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:36,779 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:36,779 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:36,779 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,779 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 07:01:36,779 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:01:36,782 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,782 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 07:01:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:36,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:36,782 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:36,782 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 07:01:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:36,784 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. completed. 2023-09-27 07:01:36,784 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-09-27 07:01:36,784 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:01:36,784 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,787 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 07:01:36,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:36,787 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-09-27 07:01:36,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40331,1695798070393': 2023-09-27 07:01:36,790 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 07:01:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:36,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:01:36,794 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 07:01:36,794 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-09-27 07:01:36,794 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:01:36,794 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:01:36,794 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,794 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:01:36,796 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,796 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:36,796 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:36,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,796 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,796 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,796 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:36,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,796 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:36,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:36,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:36,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:36,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:36,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:36,797 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:36,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:36,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:36,797 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,798 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,800 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:36,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,800 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:36,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 07:01:36,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:01:36,801 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,801 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:01:36,802 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:36,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:36,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:36,805 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:36,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:36,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:36,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:36,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:36,807 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:36,805 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:36,805 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:36,805 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:36,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:36,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:36,807 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-27 07:01:36,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:36,807 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:36,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:36,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,808 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,808 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:01:36,808 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:36,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:36,808 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:36,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:36,808 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,808 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,809 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 07:01:36,820 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,821 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,845 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,846 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-27 07:01:36,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,846 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:36,846 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695798096697Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695798096820 (+123 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1695798096820Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1695798096820Writing data manifest for emptySnaptb0-testExportFileSystemState at 1695798096824 (+4 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1695798096836 (+12 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695798096846 (+10 ms) 2023-09-27 07:01:36,849 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 07:01:36,851 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 150 msec 2023-09-27 07:01:37,002 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:37,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 07:01:37,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:01:37,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40331] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:01:37,008 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:01:37,013 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-09-27 07:01:37,013 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:37,013 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:01:37,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:01:37,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798097027 (current time:1695798097027). 2023-09-27 07:01:37,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:01:37,028 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x45a32783 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:37,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18bed031, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:37,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:37,039 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40524, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:37,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x45a32783 to 127.0.0.1:53388 2023-09-27 07:01:37,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:37,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x3c7df26c to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:37,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@eef2e31, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:37,048 DEBUG [hconnection-0x12715f5d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:37,049 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:37,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:37,056 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59896, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:37,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c7df26c to 127.0.0.1:53388 2023-09-27 07:01:37,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:37,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 07:01:37,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:01:37,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:01:37,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:01:37,063 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:01:37,064 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695798697064 2023-09-27 07:01:37,064 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-09-27 07:01:37,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:01:37,065 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:01:37,065 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:01:37,067 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:01:37,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 07:01:37,068 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-09-27 07:01:37,069 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 07:01:37,070 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695798697070 2023-09-27 07:01:37,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-09-27 07:01:37,081 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-09-27 07:01:37,081 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:37,083 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-09-27 07:01:37,083 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-09-27 07:01:37,084 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,084 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,085 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:37,085 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:37,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:37,085 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:37,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:37,085 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:37,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:37,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,086 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,086 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,086 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,087 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 07:01:37,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 07:01:37,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-09-27 07:01:37,087 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 07:01:37,087 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 07:01:37,087 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:37,087 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-09-27 07:01:37,089 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:37,089 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 07:01:37,090 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 07:01:37,087 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:37,090 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 07:01:37,091 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 07:01:37,091 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 07:01:37,090 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-09-27 07:01:37,091 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-09-27 07:01:37,091 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 07:01:37,092 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-09-27 07:01:37,099 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,099 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,099 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,099 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,099 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,099 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:37,100 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,100 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,100 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,100 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:37,100 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:37,100 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:37,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 07:01:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:37,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-27 07:01:37,102 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d6d8c3a[Count = 1] remaining members to acquire global barrier 2023-09-27 07:01:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:37,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 07:01:37,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:37,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-09-27 07:01:37,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d6d8c3a[Count = 0] remaining members to acquire global barrier 2023-09-27 07:01:37,105 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 07:01:37,105 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,112 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,112 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,112 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,112 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,113 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:01:37,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,113 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 07:01:37,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:37,113 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:37,113 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,113 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:37,113 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:01:37,114 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. started... 2023-09-27 07:01:37,113 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:37,114 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. started... 2023-09-27 07:01:37,114 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6bac4bc81d183f608d93985d2cc08ce8 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-27 07:01:37,114 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c3d684b5917f27d9ea4f687bb8d7eeac 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-27 07:01:37,116 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 07:01:37,116 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:37,116 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 07:01:37,151 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023092733e4d35e3bda402ab37b4bf359f21845 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092733e4d35e3bda402ab37b4bf359f21845 2023-09-27 07:01:37,157 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927b8b25fb059d241c38d8b56eafe6bc100 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927b8b25fb059d241c38d8b56eafe6bc100 2023-09-27 07:01:37,166 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:37,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 07:01:37,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:01:37,167 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:01:37,173 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/.tmp/cf/a4d9c703f4944142b2f5a9cd9b91b3f4 2023-09-27 07:01:37,174 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/.tmp/cf/a68b74008bba476eaba1eec2876344e5 2023-09-27 07:01:37,181 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/.tmp/cf/a68b74008bba476eaba1eec2876344e5 as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/cf/a68b74008bba476eaba1eec2876344e5 2023-09-27 07:01:37,182 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/.tmp/cf/a4d9c703f4944142b2f5a9cd9b91b3f4 as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/cf/a4d9c703f4944142b2f5a9cd9b91b3f4 2023-09-27 07:01:37,189 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/cf/a68b74008bba476eaba1eec2876344e5, entries=3, sequenceid=6, filesize=5.4 K 2023-09-27 07:01:37,190 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/cf/a4d9c703f4944142b2f5a9cd9b91b3f4, entries=47, sequenceid=6, filesize=12.8 K 2023-09-27 07:01:37,190 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 6bac4bc81d183f608d93985d2cc08ce8 in 76ms, sequenceid=6, compaction requested=false 2023-09-27 07:01:37,190 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-09-27 07:01:37,191 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6bac4bc81d183f608d93985d2cc08ce8: 2023-09-27 07:01:37,191 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 07:01:37,191 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:37,191 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/cf/a68b74008bba476eaba1eec2876344e5] hfiles 2023-09-27 07:01:37,191 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for c3d684b5917f27d9ea4f687bb8d7eeac in 77ms, sequenceid=6, compaction requested=false 2023-09-27 07:01:37,191 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/cf/a68b74008bba476eaba1eec2876344e5 for snapshot=snaptb0-testExportFileSystemState 2023-09-27 07:01:37,193 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c3d684b5917f27d9ea4f687bb8d7eeac: 2023-09-27 07:01:37,193 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 07:01:37,193 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:37,193 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/cf/a4d9c703f4944142b2f5a9cd9b91b3f4] hfiles 2023-09-27 07:01:37,193 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/cf/a4d9c703f4944142b2f5a9cd9b91b3f4 for snapshot=snaptb0-testExportFileSystemState 2023-09-27 07:01:37,211 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. completed. 2023-09-27 07:01:37,211 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:37,211 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:37,211 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:37,211 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,211 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 07:01:37,211 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:01:37,212 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. completed. 2023-09-27 07:01:37,212 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:37,212 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:37,212 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:37,212 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,212 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-09-27 07:01:37,212 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:01:37,218 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 07:01:37,218 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,218 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:37,218 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:37,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:37,218 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-09-27 07:01:37,220 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:37,218 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 07:01:37,218 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,220 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-09-27 07:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:37,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 07:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 07:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 07:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:37,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 07:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 07:01:37,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,40331,1695798070393': 2023-09-27 07:01:37,228 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 07:01:37,228 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-09-27 07:01:37,229 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:01:37,229 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:01:37,229 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-09-27 07:01:37,229 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:01:37,230 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,230 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,230 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:37,230 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,230 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:37,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,231 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,230 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:37,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:37,231 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:37,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:37,232 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,232 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 07:01:37,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:37,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 07:01:37,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,234 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:37,235 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-09-27 07:01:37,235 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,238 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,238 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,238 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,238 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:37,238 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:37,238 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,238 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,238 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:37,239 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,239 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:37,238 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:37,239 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:37,240 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:37,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:37,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:37,240 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:37,240 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:37,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:37,239 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-09-27 07:01:37,239 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:37,241 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-09-27 07:01:37,241 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:37,241 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-09-27 07:01:37,241 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,241 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:01:37,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:37,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:37,241 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:37,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:37,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927b8b25fb059d241c38d8b56eafe6bc100, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092733e4d35e3bda402ab37b4bf359f21845] mob files 2023-09-27 07:01:37,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927b8b25fb059d241c38d8b56eafe6bc100 2023-09-27 07:01:37,242 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092733e4d35e3bda402ab37b4bf359f21845 2023-09-27 07:01:37,252 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-09-27 07:01:37,253 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,279 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,280 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-09-27 07:01:37,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,280 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1695798097064Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1695798097252 (+188 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1695798097252Loading Region manifests for snaptb0-testExportFileSystemState at 1695798097252Writing data manifest for snaptb0-testExportFileSystemState at 1695798097257 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1695798097270 (+13 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1695798097280 (+10 ms) 2023-09-27 07:01:37,283 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-09-27 07:01:37,285 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 218 msec 2023-09-27 07:01:37,367 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:37,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 07:01:37,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:01:37,369 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798097369 2023-09-27 07:01:37,369 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35855, tgtDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798097369, rawTgtDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798097369, srcFsUri=hdfs://localhost:35855, srcDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:01:37,393 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:01:37,393 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1260017212_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798097369, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798097369/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,393 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18, snapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-09-27 07:01:37,410 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798097369/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-09-27 07:01:37,441 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:37,441 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:37,442 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:37,442 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:38,348 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-2762763175910380121.jar 2023-09-27 07:01:38,348 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:38,349 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:38,417 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-998047496252116527.jar 2023-09-27 07:01:38,418 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:38,418 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:38,419 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:38,419 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:38,419 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:38,420 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:38,420 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 07:01:38,420 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 07:01:38,421 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 07:01:38,421 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 07:01:38,422 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 07:01:38,422 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 07:01:38,422 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 07:01:38,423 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 07:01:38,423 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 07:01:38,424 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 07:01:38,424 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:38,425 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:38,425 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:01:38,426 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:38,426 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:38,426 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:01:38,427 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:01:38,891 WARN [Listener at jenkins-hbase4.apache.org/36133] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 07:01:38,894 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-09-27 07:01:38,896 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-09-27 07:01:39,505 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:01:39,505 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:01:39,512 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0001_000001 (auth:SIMPLE) 2023-09-27 07:01:40,289 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0002_000001 (auth:SIMPLE) 2023-09-27 07:01:41,291 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 07:01:44,503 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0002_000001 (auth:SIMPLE) 2023-09-27 07:01:46,737 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0002_000001 (auth:SIMPLE) 2023-09-27 07:01:49,370 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0002_000001 (auth:SIMPLE) 2023-09-27 07:01:51,080 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 07:01:51,081 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 07:01:51,089 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-09-27 07:01:51,089 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 07:01:51,090 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 07:01:51,090 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 07:01:51,090 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-27 07:01:51,090 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-27 07:01:51,090 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798097369/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798097369/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-09-27 07:01:51,091 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798097369/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-09-27 07:01:51,091 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798097369/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-09-27 07:01:51,098 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-09-27 07:01:51,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-09-27 07:01:51,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-09-27 07:01:51,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 07:01:51,104 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798111104"}]},"ts":"1695798111104"} 2023-09-27 07:01:51,105 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-09-27 07:01:51,107 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-09-27 07:01:51,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6bac4bc81d183f608d93985d2cc08ce8, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3d684b5917f27d9ea4f687bb8d7eeac, UNASSIGN}] 2023-09-27 07:01:51,110 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3d684b5917f27d9ea4f687bb8d7eeac, UNASSIGN 2023-09-27 07:01:51,110 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6bac4bc81d183f608d93985d2cc08ce8, UNASSIGN 2023-09-27 07:01:51,111 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c3d684b5917f27d9ea4f687bb8d7eeac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:51,111 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6bac4bc81d183f608d93985d2cc08ce8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:51,111 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695798111111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798111111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798111111"}]},"ts":"1695798111111"} 2023-09-27 07:01:51,111 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695798111111"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798111111"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798111111"}]},"ts":"1695798111111"} 2023-09-27 07:01:51,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 6bac4bc81d183f608d93985d2cc08ce8, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:01:51,114 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure c3d684b5917f27d9ea4f687bb8d7eeac, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:01:51,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 07:01:51,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:51,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6bac4bc81d183f608d93985d2cc08ce8, disabling compactions & flushes 2023-09-27 07:01:51,266 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:51,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:51,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. after waiting 0 ms 2023-09-27 07:01:51,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:51,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:51,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c3d684b5917f27d9ea4f687bb8d7eeac, disabling compactions & flushes 2023-09-27 07:01:51,273 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:51,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:51,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. after waiting 0 ms 2023-09-27 07:01:51,273 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:51,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:01:51,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:01:51,277 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8. 2023-09-27 07:01:51,277 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6bac4bc81d183f608d93985d2cc08ce8: 2023-09-27 07:01:51,279 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:51,280 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6bac4bc81d183f608d93985d2cc08ce8, regionState=CLOSED 2023-09-27 07:01:51,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:01:51,280 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695798111280"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798111280"}]},"ts":"1695798111280"} 2023-09-27 07:01:51,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:01:51,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac. 2023-09-27 07:01:51,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c3d684b5917f27d9ea4f687bb8d7eeac: 2023-09-27 07:01:51,283 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:51,284 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=c3d684b5917f27d9ea4f687bb8d7eeac, regionState=CLOSED 2023-09-27 07:01:51,284 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1695798111284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798111284"}]},"ts":"1695798111284"} 2023-09-27 07:01:51,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=39, resume processing ppid=37 2023-09-27 07:01:51,285 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 6bac4bc81d183f608d93985d2cc08ce8, server=jenkins-hbase4.apache.org,40331,1695798070393 in 170 msec 2023-09-27 07:01:51,287 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6bac4bc81d183f608d93985d2cc08ce8, UNASSIGN in 177 msec 2023-09-27 07:01:51,287 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=40, resume processing ppid=38 2023-09-27 07:01:51,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure c3d684b5917f27d9ea4f687bb8d7eeac, server=jenkins-hbase4.apache.org,43767,1695798070355 in 172 msec 2023-09-27 07:01:51,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=38, resume processing ppid=36 2023-09-27 07:01:51,289 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=c3d684b5917f27d9ea4f687bb8d7eeac, UNASSIGN in 180 msec 2023-09-27 07:01:51,290 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798111290"}]},"ts":"1695798111290"} 2023-09-27 07:01:51,291 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-09-27 07:01:51,294 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-09-27 07:01:51,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 196 msec 2023-09-27 07:01:51,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-09-27 07:01:51,406 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-09-27 07:01:51,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-09-27 07:01:51,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 07:01:51,411 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 07:01:51,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-09-27 07:01:51,413 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 07:01:51,414 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-09-27 07:01:51,416 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 07:01:51,416 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 07:01:51,416 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 07:01:51,416 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 07:01:51,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 07:01:51,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 07:01:51,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 07:01:51,417 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-09-27 07:01:51,418 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:51,418 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:51,418 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 07:01:51,418 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 07:01:51,418 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:51,418 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 07:01:51,418 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-09-27 07:01:51,418 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:51,418 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:51,418 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:51,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-27 07:01:51,421 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/recovered.edits] 2023-09-27 07:01:51,421 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/recovered.edits] 2023-09-27 07:01:51,425 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/cf/a68b74008bba476eaba1eec2876344e5 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/cf/a68b74008bba476eaba1eec2876344e5 2023-09-27 07:01:51,426 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/cf/a4d9c703f4944142b2f5a9cd9b91b3f4 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/cf/a4d9c703f4944142b2f5a9cd9b91b3f4 2023-09-27 07:01:51,429 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8/recovered.edits/9.seqid 2023-09-27 07:01:51,430 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac/recovered.edits/9.seqid 2023-09-27 07:01:51,430 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/6bac4bc81d183f608d93985d2cc08ce8 2023-09-27 07:01:51,430 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemState/c3d684b5917f27d9ea4f687bb8d7eeac 2023-09-27 07:01:51,430 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-09-27 07:01:51,431 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-27 07:01:51,432 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-09-27 07:01:51,436 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927b8b25fb059d241c38d8b56eafe6bc100 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b20230927b8b25fb059d241c38d8b56eafe6bc100 2023-09-27 07:01:51,438 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092733e4d35e3bda402ab37b4bf359f21845 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023092733e4d35e3bda402ab37b4bf359f21845 2023-09-27 07:01:51,438 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-09-27 07:01:51,441 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 07:01:51,444 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-09-27 07:01:51,446 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-09-27 07:01:51,448 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 07:01:51,448 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-09-27 07:01:51,448 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798111448"}]},"ts":"9223372036854775807"} 2023-09-27 07:01:51,448 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798111448"}]},"ts":"9223372036854775807"} 2023-09-27 07:01:51,453 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 07:01:51,453 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6bac4bc81d183f608d93985d2cc08ce8, NAME => 'testtb-testExportFileSystemState,,1695798095998.6bac4bc81d183f608d93985d2cc08ce8.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c3d684b5917f27d9ea4f687bb8d7eeac, NAME => 'testtb-testExportFileSystemState,1,1695798095998.c3d684b5917f27d9ea4f687bb8d7eeac.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 07:01:51,453 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-09-27 07:01:51,453 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695798111453"}]},"ts":"9223372036854775807"} 2023-09-27 07:01:51,455 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-09-27 07:01:51,459 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-09-27 07:01:51,460 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 52 msec 2023-09-27 07:01:51,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-09-27 07:01:51,522 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-09-27 07:01:51,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-09-27 07:01:51,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-09-27 07:01:51,535 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-09-27 07:01:51,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-09-27 07:01:51,568 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=767 (was 755) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:42511 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:43858 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743619998_1 at /127.0.0.1:38162 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2085 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1743619998_1 at /127.0.0.1:34462 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:38182 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-724388002_17 at /127.0.0.1:34504 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=931 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=292 (was 252) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3593 (was 3686) 2023-09-27 07:01:51,568 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-27 07:01:51,592 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=767, OpenFileDescriptor=931, MaxFileDescriptor=60000, SystemLoadAverage=292, ProcessCount=168, AvailableMemoryMB=3592 2023-09-27 07:01:51,592 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=767 is superior to 500 2023-09-27 07:01:51,595 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 07:01:51,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-09-27 07:01:51,600 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 07:01:51,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-09-27 07:01:51,601 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 07:01:51,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 07:01:51,603 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d 2023-09-27 07:01:51,603 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:01:51,604 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54 empty. 2023-09-27 07:01:51,604 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d empty. 2023-09-27 07:01:51,605 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:01:51,605 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d 2023-09-27 07:01:51,605 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-27 07:01:51,620 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-09-27 07:01:51,621 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9f19c1cd46fbea7af1148019efb69a54, NAME => 'testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:01:51,621 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 124ec760b4de703d6a71ab58da32152d, NAME => 'testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:01:51,638 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:51,638 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:51,638 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing 9f19c1cd46fbea7af1148019efb69a54, disabling compactions & flushes 2023-09-27 07:01:51,639 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 124ec760b4de703d6a71ab58da32152d, disabling compactions & flushes 2023-09-27 07:01:51,639 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:51,639 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:51,639 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:51,639 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. after waiting 0 ms 2023-09-27 07:01:51,639 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:51,639 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:51,639 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:51,639 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for 9f19c1cd46fbea7af1148019efb69a54: 2023-09-27 07:01:51,639 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. after waiting 0 ms 2023-09-27 07:01:51,639 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:51,639 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:51,639 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 124ec760b4de703d6a71ab58da32152d: 2023-09-27 07:01:51,642 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 07:01:51,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695798111643"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798111643"}]},"ts":"1695798111643"} 2023-09-27 07:01:51,643 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695798111643"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798111643"}]},"ts":"1695798111643"} 2023-09-27 07:01:51,645 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 07:01:51,646 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 07:01:51,647 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798111646"}]},"ts":"1695798111646"} 2023-09-27 07:01:51,648 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-09-27 07:01:51,652 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 07:01:51,653 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 07:01:51,653 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 07:01:51,653 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 07:01:51,653 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 07:01:51,654 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=124ec760b4de703d6a71ab58da32152d, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9f19c1cd46fbea7af1148019efb69a54, ASSIGN}] 2023-09-27 07:01:51,660 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9f19c1cd46fbea7af1148019efb69a54, ASSIGN 2023-09-27 07:01:51,660 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=124ec760b4de703d6a71ab58da32152d, ASSIGN 2023-09-27 07:01:51,661 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9f19c1cd46fbea7af1148019efb69a54, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1695798070355; forceNewPlan=false, retain=false 2023-09-27 07:01:51,661 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=124ec760b4de703d6a71ab58da32152d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33339,1695798070304; forceNewPlan=false, retain=false 2023-09-27 07:01:51,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 07:01:51,811 INFO [jenkins-hbase4:41725] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 07:01:51,814 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=124ec760b4de703d6a71ab58da32152d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:51,814 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=9f19c1cd46fbea7af1148019efb69a54, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:51,814 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695798111814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798111814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798111814"}]},"ts":"1695798111814"} 2023-09-27 07:01:51,814 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695798111814"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798111814"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798111814"}]},"ts":"1695798111814"} 2023-09-27 07:01:51,816 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 124ec760b4de703d6a71ab58da32152d, server=jenkins-hbase4.apache.org,33339,1695798070304}] 2023-09-27 07:01:51,817 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure 9f19c1cd46fbea7af1148019efb69a54, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:01:51,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 07:01:51,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:51,972 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:51,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 124ec760b4de703d6a71ab58da32152d, NAME => 'testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 07:01:51,972 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9f19c1cd46fbea7af1148019efb69a54, NAME => 'testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 07:01:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. service=AccessControlService 2023-09-27 07:01:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. service=AccessControlService 2023-09-27 07:01:51,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:51,973 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:01:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:01:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 124ec760b4de703d6a71ab58da32152d 2023-09-27 07:01:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:01:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:01:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 124ec760b4de703d6a71ab58da32152d 2023-09-27 07:01:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:01:51,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 124ec760b4de703d6a71ab58da32152d 2023-09-27 07:01:51,975 INFO [StoreOpener-9f19c1cd46fbea7af1148019efb69a54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:01:51,975 INFO [StoreOpener-124ec760b4de703d6a71ab58da32152d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 124ec760b4de703d6a71ab58da32152d 2023-09-27 07:01:51,976 DEBUG [StoreOpener-9f19c1cd46fbea7af1148019efb69a54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/cf 2023-09-27 07:01:51,976 DEBUG [StoreOpener-124ec760b4de703d6a71ab58da32152d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/cf 2023-09-27 07:01:51,976 DEBUG [StoreOpener-9f19c1cd46fbea7af1148019efb69a54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/cf 2023-09-27 07:01:51,976 DEBUG [StoreOpener-124ec760b4de703d6a71ab58da32152d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/cf 2023-09-27 07:01:51,977 INFO [StoreOpener-9f19c1cd46fbea7af1148019efb69a54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9f19c1cd46fbea7af1148019efb69a54 columnFamilyName cf 2023-09-27 07:01:51,977 INFO [StoreOpener-124ec760b4de703d6a71ab58da32152d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 124ec760b4de703d6a71ab58da32152d columnFamilyName cf 2023-09-27 07:01:51,978 INFO [StoreOpener-9f19c1cd46fbea7af1148019efb69a54-1] regionserver.HStore(310): Store=9f19c1cd46fbea7af1148019efb69a54/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:51,978 INFO [StoreOpener-124ec760b4de703d6a71ab58da32152d-1] regionserver.HStore(310): Store=124ec760b4de703d6a71ab58da32152d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:01:51,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:01:51,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d 2023-09-27 07:01:51,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:01:51,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d 2023-09-27 07:01:51,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 124ec760b4de703d6a71ab58da32152d 2023-09-27 07:01:51,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:01:51,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:01:51,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:01:51,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 124ec760b4de703d6a71ab58da32152d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62871319, jitterRate=-0.06314434111118317}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:01:51,985 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9f19c1cd46fbea7af1148019efb69a54; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70751082, jitterRate=0.05427327752113342}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:01:51,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 124ec760b4de703d6a71ab58da32152d: 2023-09-27 07:01:51,985 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9f19c1cd46fbea7af1148019efb69a54: 2023-09-27 07:01:51,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d., pid=45, masterSystemTime=1695798111968 2023-09-27 07:01:51,986 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54., pid=46, masterSystemTime=1695798111969 2023-09-27 07:01:51,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:51,988 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:51,989 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=124ec760b4de703d6a71ab58da32152d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:51,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:51,989 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:51,989 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695798111989"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798111989"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798111989"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798111989"}]},"ts":"1695798111989"} 2023-09-27 07:01:51,989 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=9f19c1cd46fbea7af1148019efb69a54, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:51,990 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695798111989"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798111989"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798111989"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798111989"}]},"ts":"1695798111989"} 2023-09-27 07:01:51,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=45, resume processing ppid=43 2023-09-27 07:01:51,993 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 124ec760b4de703d6a71ab58da32152d, server=jenkins-hbase4.apache.org,33339,1695798070304 in 175 msec 2023-09-27 07:01:51,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=46, resume processing ppid=44 2023-09-27 07:01:51,994 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure 9f19c1cd46fbea7af1148019efb69a54, server=jenkins-hbase4.apache.org,43767,1695798070355 in 174 msec 2023-09-27 07:01:51,994 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=124ec760b4de703d6a71ab58da32152d, ASSIGN in 339 msec 2023-09-27 07:01:51,995 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=44, resume processing ppid=42 2023-09-27 07:01:51,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9f19c1cd46fbea7af1148019efb69a54, ASSIGN in 340 msec 2023-09-27 07:01:51,996 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 07:01:51,996 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798111996"}]},"ts":"1695798111996"} 2023-09-27 07:01:51,998 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-09-27 07:01:52,000 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 07:01:52,000 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-09-27 07:01:52,002 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 07:01:52,004 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:52,004 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:52,004 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:52,005 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:01:52,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:52,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:52,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:52,006 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-09-27 07:01:52,008 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 411 msec 2023-09-27 07:01:52,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-09-27 07:01:52,205 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-09-27 07:01:52,208 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-27 07:01:52,208 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:52,210 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:01:52,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 07:01:52,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798112224 (current time:1695798112224). 2023-09-27 07:01:52,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:01:52,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x6de835da to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:52,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3175a7c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:52,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:52,237 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:52,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6de835da to 127.0.0.1:53388 2023-09-27 07:01:52,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:52,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x60129a5e to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:52,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cf82563, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:52,249 DEBUG [hconnection-0x502ff8a4-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:52,254 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:52,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:52,262 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:52,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60129a5e to 127.0.0.1:53388 2023-09-27 07:01:52,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:52,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 07:01:52,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:01:52,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 07:01:52,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 07:01:52,268 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 07:01:52,269 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695798712269 2023-09-27 07:01:52,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 07:01:52,269 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-27 07:01:52,271 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:01:52,271 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:01:52,273 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 07:01:52,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 07:01:52,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 7 msec 2023-09-27 07:01:52,277 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 07:01:52,278 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695798712278 2023-09-27 07:01:52,291 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,292 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-09-27 07:01:52,292 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:52,294 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-09-27 07:01:52,294 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-27 07:01:52,294 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,294 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,295 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,295 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,295 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,295 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,296 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,296 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,296 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,297 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,297 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,297 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 07:01:52,297 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 07:01:52,297 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,297 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:52,298 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 07:01:52,299 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 07:01:52,299 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 07:01:52,297 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:52,299 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 07:01:52,301 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 07:01:52,301 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 07:01:52,301 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 07:01:52,299 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:52,304 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 07:01:52,304 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-09-27 07:01:52,304 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-09-27 07:01:52,306 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,306 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:52,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:52,306 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,308 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,308 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,308 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,308 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:52,308 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,308 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:52,308 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,308 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:52,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:52,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-27 07:01:52,310 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@372dfae4[Count = 1] remaining members to acquire global barrier 2023-09-27 07:01:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:52,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:52,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-09-27 07:01:52,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@372dfae4[Count = 0] remaining members to acquire global barrier 2023-09-27 07:01:52,312 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-27 07:01:52,312 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,313 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,313 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,313 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,314 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 07:01:52,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,314 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,314 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 07:01:52,314 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 07:01:52,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,314 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:01:52,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,314 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,314 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 07:01:52,314 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:01:52,314 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:52,314 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:52,314 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:52,314 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:52,314 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:52,314 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. started... 2023-09-27 07:01:52,314 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:52,315 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. started... 2023-09-27 07:01:52,315 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 124ec760b4de703d6a71ab58da32152d: 2023-09-27 07:01:52,316 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9f19c1cd46fbea7af1148019efb69a54: 2023-09-27 07:01:52,316 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,316 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,317 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:52,317 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:52,317 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:01:52,317 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:01:52,322 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 07:01:52,322 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:52,322 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 07:01:52,330 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. completed. 2023-09-27 07:01:52,331 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:52,331 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:52,331 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:52,331 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,331 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 07:01:52,331 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:01:52,332 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. completed. 2023-09-27 07:01:52,332 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:52,332 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:52,332 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:52,332 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,332 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-09-27 07:01:52,332 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:01:52,334 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 07:01:52,334 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,334 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:52,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:52,334 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 07:01:52,337 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 07:01:52,337 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:52,337 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:52,337 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-09-27 07:01:52,339 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:52,340 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:52,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:01:52,344 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-27 07:01:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:52,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:52,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:52,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33339,1695798070304': 2023-09-27 07:01:52,347 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-27 07:01:52,347 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-09-27 07:01:52,347 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:01:52,347 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:01:52,347 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,347 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:01:52,348 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,349 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,349 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,349 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,349 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,349 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:52,349 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,349 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:52,349 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,349 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:52,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,350 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,350 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:52,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,352 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:52,353 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,353 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,357 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,357 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,357 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,356 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,356 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:52,356 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,358 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,358 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,357 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-27 07:01:52,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:01:52,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 07:01:52,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,368 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,371 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:52,372 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 07:01:52,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:01:52,373 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:01:52,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,388 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-27 07:01:52,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,389 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-09-27 07:01:52,389 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695798112270Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695798112367 (+97 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1695798112367Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1695798112367Writing data manifest for emptySnaptb0-testConsecutiveExports at 1695798112371 (+4 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1695798112381 (+10 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695798112388 (+7 ms) 2023-09-27 07:01:52,392 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 07:01:52,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 121 msec 2023-09-27 07:01:52,573 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:52,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 07:01:52,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:01:52,577 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33339] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:01:52,579 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:01:52,583 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-09-27 07:01:52,583 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:52,583 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:01:52,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 07:01:52,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798112593 (current time:1695798112593). 2023-09-27 07:01:52,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:01:52,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x082c9aea to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:52,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ef9391e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:52,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:52,610 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:52,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x082c9aea to 127.0.0.1:53388 2023-09-27 07:01:52,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:52,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x08d94c31 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:01:52,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@644e6c0a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:01:52,620 DEBUG [hconnection-0x23b88854-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:52,623 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:52,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:01:52,628 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56924, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:01:52,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08d94c31 to 127.0.0.1:53388 2023-09-27 07:01:52,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:01:52,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-09-27 07:01:52,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:01:52,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 07:01:52,632 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 07:01:52,633 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 07:01:52,634 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1695798712634 2023-09-27 07:01:52,634 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-09-27 07:01:52,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-09-27 07:01:52,636 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:01:52,636 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:01:52,637 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-09-27 07:01:52,637 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 07:01:52,638 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 6 msec 2023-09-27 07:01:52,639 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 07:01:52,640 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1695798712640 2023-09-27 07:01:52,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-09-27 07:01:52,657 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-09-27 07:01:52,657 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:52,658 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-09-27 07:01:52,659 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-09-27 07:01:52,659 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,659 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,661 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,661 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,661 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,661 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,661 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,662 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,662 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,662 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,662 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:01:52,662 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 07:01:52,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,663 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 07:01:52,663 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 07:01:52,663 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 07:01:52,663 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:52,665 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 07:01:52,665 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 07:01:52,665 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 07:01:52,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 07:01:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-09-27 07:01:52,667 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,667 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,667 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 07:01:52,667 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-09-27 07:01:52,667 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,667 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:52,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:52,667 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 07:01:52,668 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-09-27 07:01:52,668 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 07:01:52,668 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-09-27 07:01:52,668 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:52,668 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:01:52,669 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 07:01:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 07:01:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-09-27 07:01:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-09-27 07:01:52,670 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 07:01:52,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:52,671 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-09-27 07:01:52,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:52,672 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,672 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 07:01:52,673 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,673 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,673 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,673 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,673 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:01:52,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:52,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-27 07:01:52,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d26990d[Count = 1] remaining members to acquire global barrier 2023-09-27 07:01:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:52,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 07:01:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,676 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:52,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-09-27 07:01:52,676 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@d26990d[Count = 0] remaining members to acquire global barrier 2023-09-27 07:01:52,676 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-09-27 07:01:52,676 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,679 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,679 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,679 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 07:01:52,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,679 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 07:01:52,679 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:01:52,679 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,679 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 07:01:52,679 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,679 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-09-27 07:01:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:52,680 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:52,680 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:52,680 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. started... 2023-09-27 07:01:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:01:52,680 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:01:52,680 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. started... 2023-09-27 07:01:52,680 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 124ec760b4de703d6a71ab58da32152d 1/1 column families, dataSize=199 B heapSize=688 B 2023-09-27 07:01:52,680 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9f19c1cd46fbea7af1148019efb69a54 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-09-27 07:01:52,685 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,685 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,685 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:01:52,687 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 07:01:52,687 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:52,687 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 07:01:52,724 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927e35e260af79e4b5a8178fd43752a8761 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927e35e260af79e4b5a8178fd43752a8761 2023-09-27 07:01:52,726 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927892a9099ef0e46bcb1b659ef5d60696c to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927892a9099ef0e46bcb1b659ef5d60696c 2023-09-27 07:01:52,732 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/.tmp/cf/69bb2d4da4424be19a705e2726d64b6c 2023-09-27 07:01:52,735 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/.tmp/cf/f7ec15dd7b3b4bf4b8a8f935c88b869a 2023-09-27 07:01:52,736 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:52,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 07:01:52,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:01:52,738 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:01:52,738 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/.tmp/cf/69bb2d4da4424be19a705e2726d64b6c as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/cf/69bb2d4da4424be19a705e2726d64b6c 2023-09-27 07:01:52,741 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/.tmp/cf/f7ec15dd7b3b4bf4b8a8f935c88b869a as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/cf/f7ec15dd7b3b4bf4b8a8f935c88b869a 2023-09-27 07:01:52,743 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/cf/69bb2d4da4424be19a705e2726d64b6c, entries=3, sequenceid=6, filesize=5.4 K 2023-09-27 07:01:52,744 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 124ec760b4de703d6a71ab58da32152d in 64ms, sequenceid=6, compaction requested=false 2023-09-27 07:01:52,744 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-09-27 07:01:52,745 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 124ec760b4de703d6a71ab58da32152d: 2023-09-27 07:01:52,745 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 07:01:52,745 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:52,745 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/cf/69bb2d4da4424be19a705e2726d64b6c] hfiles 2023-09-27 07:01:52,745 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/cf/69bb2d4da4424be19a705e2726d64b6c for snapshot=snaptb0-testConsecutiveExports 2023-09-27 07:01:52,746 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/cf/f7ec15dd7b3b4bf4b8a8f935c88b869a, entries=47, sequenceid=6, filesize=12.7 K 2023-09-27 07:01:52,747 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 9f19c1cd46fbea7af1148019efb69a54 in 67ms, sequenceid=6, compaction requested=false 2023-09-27 07:01:52,749 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9f19c1cd46fbea7af1148019efb69a54: 2023-09-27 07:01:52,749 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 07:01:52,749 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:01:52,749 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/cf/f7ec15dd7b3b4bf4b8a8f935c88b869a] hfiles 2023-09-27 07:01:52,749 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/cf/f7ec15dd7b3b4bf4b8a8f935c88b869a for snapshot=snaptb0-testConsecutiveExports 2023-09-27 07:01:52,762 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. completed. 2023-09-27 07:01:52,762 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:01:52,762 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:52,762 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:52,762 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,762 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 07:01:52,762 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:01:52,764 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,764 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 07:01:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:52,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:52,764 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. completed. 2023-09-27 07:01:52,764 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:52,764 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:01:52,764 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 07:01:52,766 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:01:52,766 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:01:52,766 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,766 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-09-27 07:01:52,766 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:01:52,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:52,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:52,768 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,768 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-09-27 07:01:52,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 07:01:52,768 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:52,768 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-09-27 07:01:52,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:52,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 07:01:52,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,33339,1695798070304': 2023-09-27 07:01:52,771 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-09-27 07:01:52,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:52,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:52,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:52,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:52,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 07:01:52,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:52,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 07:01:52,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:01:52,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-09-27 07:01:52,775 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-09-27 07:01:52,775 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:01:52,775 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:01:52,775 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-09-27 07:01:52,775 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:01:52,778 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,778 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,778 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,778 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,778 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:01:52,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:01:52,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,778 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,778 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:01:52,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,779 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 07:01:52,779 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:01:52,785 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 07:01:52,785 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:01:52,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-09-27 07:01:52,787 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,787 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,788 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,793 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,793 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,794 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,793 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:01:52,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,794 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,794 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,794 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:01:52,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:01:52,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,794 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:01:52,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:01:52,794 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-09-27 07:01:52,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,796 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-09-27 07:01:52,794 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-09-27 07:01:52,796 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:01:52,796 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,796 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:01:52,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:01:52,796 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,797 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:01:52,797 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,797 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:01:52,797 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:01:52,797 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,797 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927892a9099ef0e46bcb1b659ef5d60696c, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927e35e260af79e4b5a8178fd43752a8761] mob files 2023-09-27 07:01:52,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927892a9099ef0e46bcb1b659ef5d60696c 2023-09-27 07:01:52,798 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927e35e260af79e4b5a8178fd43752a8761 2023-09-27 07:01:52,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-09-27 07:01:52,807 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,825 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,826 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-09-27 07:01:52,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,826 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,826 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1695798112634Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1695798112807 (+173 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1695798112807Loading Region manifests for snaptb0-testConsecutiveExports at 1695798112807Writing data manifest for snaptb0-testConsecutiveExports at 1695798112811 (+4 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1695798112818 (+7 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1695798112826 (+8 ms) 2023-09-27 07:01:52,829 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-09-27 07:01:52,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 194 msec 2023-09-27 07:01:52,938 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:01:52,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-09-27 07:01:52,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:01:52,940 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939 2023-09-27 07:01:52,940 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939, srcFsUri=hdfs://localhost:35855, srcDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:01:52,962 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:01:52,962 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@4722d792, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,962 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18, snapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-27 07:01:52,971 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 07:01:52,983 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:52,984 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:52,984 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:52,985 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:53,864 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-7483215321526922694.jar 2023-09-27 07:01:53,865 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:53,865 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:53,932 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-6627193727615454925.jar 2023-09-27 07:01:53,932 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:53,933 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:53,933 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:53,934 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:53,934 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:53,934 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 07:01:53,935 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 07:01:53,935 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 07:01:53,935 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 07:01:53,936 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 07:01:53,936 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 07:01:53,937 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 07:01:53,937 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 07:01:53,937 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 07:01:53,938 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 07:01:53,938 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 07:01:53,939 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:53,939 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:53,940 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:01:53,940 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:53,940 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:01:53,941 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:01:53,941 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:01:54,333 WARN [Listener at jenkins-hbase4.apache.org/36133] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 07:01:54,336 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-27 07:01:54,338 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-27 07:01:55,544 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:01:55,544 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:01:55,547 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0002_000001 (auth:SIMPLE) 2023-09-27 07:01:56,513 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0003_000001 (auth:SIMPLE) 2023-09-27 07:01:56,857 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 07:02:00,277 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0003_000001 (auth:SIMPLE) 2023-09-27 07:02:02,501 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0003_000001 (auth:SIMPLE) 2023-09-27 07:02:04,876 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0003_000001 (auth:SIMPLE) 2023-09-27 07:02:06,514 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 07:02:06,514 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 07:02:06,519 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-27 07:02:06,519 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 07:02:06,520 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 07:02:06,520 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 07:02:06,523 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 07:02:06,523 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 07:02:06,523 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1bab269c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 07:02:06,523 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 07:02:06,523 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 07:02:06,524 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939, srcFsUri=hdfs://localhost:35855, srcDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:02:06,546 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:02:06,547 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@6944d8de, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 07:02:06,547 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18, snapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-09-27 07:02:06,559 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-09-27 07:02:06,571 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:06,571 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:06,571 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:06,572 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:07,450 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-8160683287404672932.jar 2023-09-27 07:02:07,450 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:07,450 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:07,517 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-7037806599083534452.jar 2023-09-27 07:02:07,517 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:07,517 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:07,518 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:07,518 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:07,519 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:07,519 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:07,519 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 07:02:07,520 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 07:02:07,520 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 07:02:07,521 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 07:02:07,521 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 07:02:07,521 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 07:02:07,522 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 07:02:07,522 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 07:02:07,522 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 07:02:07,523 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 07:02:07,523 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:07,524 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:07,524 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:07,525 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:07,525 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:07,525 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:07,526 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:07,930 WARN [Listener at jenkins-hbase4.apache.org/36133] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 07:02:07,932 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-09-27 07:02:07,935 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-09-27 07:02:11,048 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:02:11,049 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:02:11,052 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0003_000001 (auth:SIMPLE) 2023-09-27 07:02:11,557 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0004_000001 (auth:SIMPLE) 2023-09-27 07:02:15,377 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0004_000001 (auth:SIMPLE) 2023-09-27 07:02:17,588 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0004_000001 (auth:SIMPLE) 2023-09-27 07:02:19,911 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0004_000001 (auth:SIMPLE) 2023-09-27 07:02:21,104 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 07:02:21,104 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 07:02:21,107 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-09-27 07:02:21,107 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 07:02:21,107 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 07:02:21,108 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 07:02:21,111 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 07:02:21,111 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 07:02:21,112 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@1bab269c in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-09-27 07:02:21,112 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-09-27 07:02:21,112 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/local-export-1695798112939/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-09-27 07:02:21,124 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-09-27 07:02:21,125 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-09-27 07:02:21,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-09-27 07:02:21,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 07:02:21,129 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798141129"}]},"ts":"1695798141129"} 2023-09-27 07:02:21,131 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-09-27 07:02:21,133 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-09-27 07:02:21,134 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=124ec760b4de703d6a71ab58da32152d, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9f19c1cd46fbea7af1148019efb69a54, UNASSIGN}] 2023-09-27 07:02:21,136 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9f19c1cd46fbea7af1148019efb69a54, UNASSIGN 2023-09-27 07:02:21,136 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=124ec760b4de703d6a71ab58da32152d, UNASSIGN 2023-09-27 07:02:21,137 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=9f19c1cd46fbea7af1148019efb69a54, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:21,137 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=124ec760b4de703d6a71ab58da32152d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:21,137 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695798141136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798141136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798141136"}]},"ts":"1695798141136"} 2023-09-27 07:02:21,137 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695798141137"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798141137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798141137"}]},"ts":"1695798141137"} 2023-09-27 07:02:21,138 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=54, ppid=53, state=RUNNABLE; CloseRegionProcedure 9f19c1cd46fbea7af1148019efb69a54, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:02:21,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=55, ppid=52, state=RUNNABLE; CloseRegionProcedure 124ec760b4de703d6a71ab58da32152d, server=jenkins-hbase4.apache.org,33339,1695798070304}] 2023-09-27 07:02:21,230 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 07:02:21,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:02:21,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 124ec760b4de703d6a71ab58da32152d 2023-09-27 07:02:21,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9f19c1cd46fbea7af1148019efb69a54, disabling compactions & flushes 2023-09-27 07:02:21,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 124ec760b4de703d6a71ab58da32152d, disabling compactions & flushes 2023-09-27 07:02:21,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:02:21,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:02:21,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:02:21,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:02:21,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. after waiting 0 ms 2023-09-27 07:02:21,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. after waiting 0 ms 2023-09-27 07:02:21,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:02:21,291 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:02:21,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:02:21,302 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:02:21,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:02:21,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:02:21,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d. 2023-09-27 07:02:21,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54. 2023-09-27 07:02:21,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 124ec760b4de703d6a71ab58da32152d: 2023-09-27 07:02:21,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9f19c1cd46fbea7af1148019efb69a54: 2023-09-27 07:02:21,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 124ec760b4de703d6a71ab58da32152d 2023-09-27 07:02:21,307 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=124ec760b4de703d6a71ab58da32152d, regionState=CLOSED 2023-09-27 07:02:21,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:02:21,307 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695798141307"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798141307"}]},"ts":"1695798141307"} 2023-09-27 07:02:21,308 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=9f19c1cd46fbea7af1148019efb69a54, regionState=CLOSED 2023-09-27 07:02:21,308 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1695798141308"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798141308"}]},"ts":"1695798141308"} 2023-09-27 07:02:21,311 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=55, resume processing ppid=52 2023-09-27 07:02:21,311 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=55, ppid=52, state=SUCCESS; CloseRegionProcedure 124ec760b4de703d6a71ab58da32152d, server=jenkins-hbase4.apache.org,33339,1695798070304 in 170 msec 2023-09-27 07:02:21,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=54, resume processing ppid=53 2023-09-27 07:02:21,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=124ec760b4de703d6a71ab58da32152d, UNASSIGN in 177 msec 2023-09-27 07:02:21,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=54, ppid=53, state=SUCCESS; CloseRegionProcedure 9f19c1cd46fbea7af1148019efb69a54, server=jenkins-hbase4.apache.org,43767,1695798070355 in 172 msec 2023-09-27 07:02:21,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=53, resume processing ppid=51 2023-09-27 07:02:21,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=9f19c1cd46fbea7af1148019efb69a54, UNASSIGN in 178 msec 2023-09-27 07:02:21,314 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798141314"}]},"ts":"1695798141314"} 2023-09-27 07:02:21,315 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-09-27 07:02:21,316 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-09-27 07:02:21,318 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 192 msec 2023-09-27 07:02:21,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-09-27 07:02:21,432 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-09-27 07:02:21,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-09-27 07:02:21,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 07:02:21,436 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 07:02:21,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-09-27 07:02:21,436 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 07:02:21,439 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-09-27 07:02:21,442 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 07:02:21,442 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 07:02:21,442 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 07:02:21,442 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 07:02:21,442 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 07:02:21,442 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 07:02:21,443 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d 2023-09-27 07:02:21,443 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 07:02:21,442 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-09-27 07:02:21,443 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:02:21,444 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 07:02:21,444 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 07:02:21,444 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:21,444 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:21,444 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 07:02:21,444 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-09-27 07:02:21,444 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:21,444 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:21,445 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/recovered.edits] 2023-09-27 07:02:21,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-27 07:02:21,446 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/recovered.edits] 2023-09-27 07:02:21,454 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/cf/69bb2d4da4424be19a705e2726d64b6c to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/cf/69bb2d4da4424be19a705e2726d64b6c 2023-09-27 07:02:21,454 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/cf/f7ec15dd7b3b4bf4b8a8f935c88b869a to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/cf/f7ec15dd7b3b4bf4b8a8f935c88b869a 2023-09-27 07:02:21,458 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d/recovered.edits/9.seqid 2023-09-27 07:02:21,458 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54/recovered.edits/9.seqid 2023-09-27 07:02:21,458 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/124ec760b4de703d6a71ab58da32152d 2023-09-27 07:02:21,458 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testConsecutiveExports/9f19c1cd46fbea7af1148019efb69a54 2023-09-27 07:02:21,458 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-09-27 07:02:21,459 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-27 07:02:21,460 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-09-27 07:02:21,463 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927892a9099ef0e46bcb1b659ef5d60696c to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b20230927892a9099ef0e46bcb1b659ef5d60696c 2023-09-27 07:02:21,464 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927e35e260af79e4b5a8178fd43752a8761 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e20230927e35e260af79e4b5a8178fd43752a8761 2023-09-27 07:02:21,464 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-09-27 07:02:21,466 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 07:02:21,469 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-09-27 07:02:21,471 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-09-27 07:02:21,472 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 07:02:21,472 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-09-27 07:02:21,472 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798141472"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:21,472 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798141472"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:21,474 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 07:02:21,474 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 124ec760b4de703d6a71ab58da32152d, NAME => 'testtb-testConsecutiveExports,,1695798111594.124ec760b4de703d6a71ab58da32152d.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9f19c1cd46fbea7af1148019efb69a54, NAME => 'testtb-testConsecutiveExports,1,1695798111594.9f19c1cd46fbea7af1148019efb69a54.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 07:02:21,474 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-09-27 07:02:21,474 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695798141474"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:21,476 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-09-27 07:02:21,478 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-09-27 07:02:21,479 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 45 msec 2023-09-27 07:02:21,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-09-27 07:02:21,547 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-09-27 07:02:21,555 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-09-27 07:02:21,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-09-27 07:02:21,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-09-27 07:02:21,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-09-27 07:02:21,583 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=749 (was 767), OpenFileDescriptor=903 (was 931), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=217 (was 292), ProcessCount=168 (was 168), AvailableMemoryMB=3479 (was 3592) 2023-09-27 07:02:21,583 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-27 07:02:21,603 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=749, OpenFileDescriptor=903, MaxFileDescriptor=60000, SystemLoadAverage=217, ProcessCount=168, AvailableMemoryMB=3478 2023-09-27 07:02:21,603 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=749 is superior to 500 2023-09-27 07:02:21,604 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 07:02:21,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:21,608 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 07:02:21,608 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-09-27 07:02:21,609 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 07:02:21,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 07:02:21,611 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:21,611 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:21,612 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004 empty. 2023-09-27 07:02:21,612 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e empty. 2023-09-27 07:02:21,612 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:21,612 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:21,613 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-27 07:02:21,622 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-09-27 07:02:21,623 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2f0a558b6a43d29cc5ae70e5f3465004, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:02:21,623 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => b75a6aa5b4d624d2553d3220a9a17e6e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:02:21,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:21,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:21,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 2f0a558b6a43d29cc5ae70e5f3465004, disabling compactions & flushes 2023-09-27 07:02:21,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing b75a6aa5b4d624d2553d3220a9a17e6e, disabling compactions & flushes 2023-09-27 07:02:21,631 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:21,631 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:21,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:21,631 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:21,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. after waiting 0 ms 2023-09-27 07:02:21,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. after waiting 0 ms 2023-09-27 07:02:21,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:21,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:21,632 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:21,632 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:21,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 2f0a558b6a43d29cc5ae70e5f3465004: 2023-09-27 07:02:21,632 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for b75a6aa5b4d624d2553d3220a9a17e6e: 2023-09-27 07:02:21,634 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 07:02:21,635 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695798141635"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798141635"}]},"ts":"1695798141635"} 2023-09-27 07:02:21,635 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695798141635"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798141635"}]},"ts":"1695798141635"} 2023-09-27 07:02:21,642 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 07:02:21,643 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 07:02:21,643 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798141643"}]},"ts":"1695798141643"} 2023-09-27 07:02:21,644 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-09-27 07:02:21,647 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 07:02:21,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 07:02:21,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 07:02:21,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 07:02:21,648 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 07:02:21,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2f0a558b6a43d29cc5ae70e5f3465004, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b75a6aa5b4d624d2553d3220a9a17e6e, ASSIGN}] 2023-09-27 07:02:21,651 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2f0a558b6a43d29cc5ae70e5f3465004, ASSIGN 2023-09-27 07:02:21,651 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b75a6aa5b4d624d2553d3220a9a17e6e, ASSIGN 2023-09-27 07:02:21,652 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b75a6aa5b4d624d2553d3220a9a17e6e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33339,1695798070304; forceNewPlan=false, retain=false 2023-09-27 07:02:21,652 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2f0a558b6a43d29cc5ae70e5f3465004, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1695798070355; forceNewPlan=false, retain=false 2023-09-27 07:02:21,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 07:02:21,802 INFO [jenkins-hbase4:41725] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 07:02:21,805 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b75a6aa5b4d624d2553d3220a9a17e6e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:21,805 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=2f0a558b6a43d29cc5ae70e5f3465004, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:21,805 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695798141805"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798141805"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798141805"}]},"ts":"1695798141805"} 2023-09-27 07:02:21,805 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695798141805"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798141805"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798141805"}]},"ts":"1695798141805"} 2023-09-27 07:02:21,807 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE; OpenRegionProcedure b75a6aa5b4d624d2553d3220a9a17e6e, server=jenkins-hbase4.apache.org,33339,1695798070304}] 2023-09-27 07:02:21,808 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=61, ppid=58, state=RUNNABLE; OpenRegionProcedure 2f0a558b6a43d29cc5ae70e5f3465004, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:02:21,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 07:02:21,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:21,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:21,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b75a6aa5b4d624d2553d3220a9a17e6e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 07:02:21,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2f0a558b6a43d29cc5ae70e5f3465004, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 07:02:21,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. service=AccessControlService 2023-09-27 07:02:21,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. service=AccessControlService 2023-09-27 07:02:21,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:02:21,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:02:21,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:21,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:21,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:21,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:21,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:21,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:21,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:21,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:21,965 INFO [StoreOpener-b75a6aa5b4d624d2553d3220a9a17e6e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:21,965 INFO [StoreOpener-2f0a558b6a43d29cc5ae70e5f3465004-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:21,967 DEBUG [StoreOpener-b75a6aa5b4d624d2553d3220a9a17e6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/cf 2023-09-27 07:02:21,967 DEBUG [StoreOpener-2f0a558b6a43d29cc5ae70e5f3465004-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/cf 2023-09-27 07:02:21,967 DEBUG [StoreOpener-2f0a558b6a43d29cc5ae70e5f3465004-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/cf 2023-09-27 07:02:21,967 DEBUG [StoreOpener-b75a6aa5b4d624d2553d3220a9a17e6e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/cf 2023-09-27 07:02:21,968 INFO [StoreOpener-2f0a558b6a43d29cc5ae70e5f3465004-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2f0a558b6a43d29cc5ae70e5f3465004 columnFamilyName cf 2023-09-27 07:02:21,968 INFO [StoreOpener-b75a6aa5b4d624d2553d3220a9a17e6e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b75a6aa5b4d624d2553d3220a9a17e6e columnFamilyName cf 2023-09-27 07:02:21,970 INFO [StoreOpener-2f0a558b6a43d29cc5ae70e5f3465004-1] regionserver.HStore(310): Store=2f0a558b6a43d29cc5ae70e5f3465004/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:02:21,970 INFO [StoreOpener-b75a6aa5b4d624d2553d3220a9a17e6e-1] regionserver.HStore(310): Store=b75a6aa5b4d624d2553d3220a9a17e6e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:02:21,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:21,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:21,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:21,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:21,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:21,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:21,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:02:21,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:02:21,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2f0a558b6a43d29cc5ae70e5f3465004; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68618738, jitterRate=0.022498875856399536}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:02:21,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b75a6aa5b4d624d2553d3220a9a17e6e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65604860, jitterRate=-0.02241140604019165}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:02:21,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2f0a558b6a43d29cc5ae70e5f3465004: 2023-09-27 07:02:21,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b75a6aa5b4d624d2553d3220a9a17e6e: 2023-09-27 07:02:21,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004., pid=61, masterSystemTime=1695798141960 2023-09-27 07:02:21,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e., pid=60, masterSystemTime=1695798141959 2023-09-27 07:02:21,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:21,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:21,980 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=2f0a558b6a43d29cc5ae70e5f3465004, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:21,980 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695798141980"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798141980"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798141980"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798141980"}]},"ts":"1695798141980"} 2023-09-27 07:02:21,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:21,980 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:21,981 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=b75a6aa5b4d624d2553d3220a9a17e6e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:21,981 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695798141981"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798141981"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798141981"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798141981"}]},"ts":"1695798141981"} 2023-09-27 07:02:21,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=61, resume processing ppid=58 2023-09-27 07:02:21,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=61, ppid=58, state=SUCCESS; OpenRegionProcedure 2f0a558b6a43d29cc5ae70e5f3465004, server=jenkins-hbase4.apache.org,43767,1695798070355 in 174 msec 2023-09-27 07:02:21,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=60, resume processing ppid=59 2023-09-27 07:02:21,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=60, ppid=59, state=SUCCESS; OpenRegionProcedure b75a6aa5b4d624d2553d3220a9a17e6e, server=jenkins-hbase4.apache.org,33339,1695798070304 in 176 msec 2023-09-27 07:02:21,986 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2f0a558b6a43d29cc5ae70e5f3465004, ASSIGN in 335 msec 2023-09-27 07:02:21,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=59, resume processing ppid=57 2023-09-27 07:02:21,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b75a6aa5b4d624d2553d3220a9a17e6e, ASSIGN in 336 msec 2023-09-27 07:02:21,988 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 07:02:21,988 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798141988"}]},"ts":"1695798141988"} 2023-09-27 07:02:21,990 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-09-27 07:02:21,993 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 07:02:21,993 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-09-27 07:02:21,995 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 07:02:21,996 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:21,996 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:21,996 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:21,996 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:21,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:21,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:21,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:21,998 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:22,000 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 393 msec 2023-09-27 07:02:22,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-09-27 07:02:22,213 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-09-27 07:02:22,215 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,216 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:22,218 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:02:22,233 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 07:02:22,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798142233 (current time:1695798142233). 2023-09-27 07:02:22,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:02:22,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x326866c6 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:22,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c247100, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:22,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:22,245 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:22,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x326866c6 to 127.0.0.1:53388 2023-09-27 07:02:22,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:22,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x25b22105 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:22,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@541d3d23, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:22,254 DEBUG [hconnection-0xb6eead1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:22,255 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40686, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:22,259 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:22,262 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:22,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x25b22105 to 127.0.0.1:53388 2023-09-27 07:02:22,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:22,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 07:02:22,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:02:22,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 07:02:22,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 07:02:22,267 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 07:02:22,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 07:02:22,268 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695798742268 2023-09-27 07:02:22,268 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,269 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:02:22,269 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:02:22,270 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 07:02:22,270 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 07:02:22,271 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-27 07:02:22,272 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 07:02:22,272 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695798742272 2023-09-27 07:02:22,281 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,281 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-27 07:02:22,281 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:22,282 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-27 07:02:22,282 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-27 07:02:22,282 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,282 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,283 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,284 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,284 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,284 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,284 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,284 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:02:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 07:02:22,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,284 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 07:02:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 07:02:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-09-27 07:02:22,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 07:02:22,285 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 07:02:22,285 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 07:02:22,285 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:22,285 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,286 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 07:02:22,286 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 07:02:22,286 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,286 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 07:02:22,286 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 07:02:22,286 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:22,286 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 07:02:22,287 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:22,287 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 07:02:22,288 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 07:02:22,288 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 07:02:22,288 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 07:02:22,288 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 07:02:22,288 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 07:02:22,290 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,290 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:22,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:22,291 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,291 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,292 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:22,292 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,292 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:22,292 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,292 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:22,292 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,292 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:22,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:22,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:22,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 07:02:22,294 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fa3e79c[Count = 1] remaining members to acquire global barrier 2023-09-27 07:02:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:22,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:22,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 07:02:22,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fa3e79c[Count = 0] remaining members to acquire global barrier 2023-09-27 07:02:22,296 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-27 07:02:22,296 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,297 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,297 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,297 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,297 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 07:02:22,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,297 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,298 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 07:02:22,298 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:22,298 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:22,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,298 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:22,298 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 07:02:22,298 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,298 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:02:22,298 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:02:22,298 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. started... 2023-09-27 07:02:22,298 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 07:02:22,298 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f0a558b6a43d29cc5ae70e5f3465004: 2023-09-27 07:02:22,298 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:22,298 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:22,298 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:22,298 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. started... 2023-09-27 07:02:22,298 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,299 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:22,300 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:02:22,300 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b75a6aa5b4d624d2553d3220a9a17e6e: 2023-09-27 07:02:22,300 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,300 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:22,300 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:02:22,305 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 07:02:22,305 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:22,305 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 07:02:22,311 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. completed. 2023-09-27 07:02:22,311 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:22,311 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. completed. 2023-09-27 07:02:22,311 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 07:02:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 07:02:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:02:22,311 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:02:22,313 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 07:02:22,313 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,313 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 07:02:22,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,313 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:22,313 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,313 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:22,313 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 07:02:22,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:22,314 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 07:02:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:22,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:22,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:02:22,319 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-27 07:02:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:22,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:22,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:22,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:22,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:22,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33339,1695798070304': 2023-09-27 07:02:22,323 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-27 07:02:22,323 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-27 07:02:22,323 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:02:22,323 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:02:22,323 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,323 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:02:22,324 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,324 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:22,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:22,325 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,325 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,325 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,326 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,326 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:22,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,326 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,328 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,329 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,329 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,332 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,332 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,332 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,332 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,332 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,332 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,332 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,332 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,332 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:22,333 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,332 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,332 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,334 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,334 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,334 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:02:22,335 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,335 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,335 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,335 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,335 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,335 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,335 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,335 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,335 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 07:02:22,342 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,343 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,366 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,366 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-27 07:02:22,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,367 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,367 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695798142268Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695798142342 (+74 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695798142342Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695798142342Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695798142349 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1695798142360 (+11 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695798142366 (+6 ms) 2023-09-27 07:02:22,370 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:22,371 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 07:02:22,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 07:02:22,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:02:22,372 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 102 msec 2023-09-27 07:02:22,374 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:02:22,375 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33339] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:02:22,378 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,379 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:22,379 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:02:22,388 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 07:02:22,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798142388 (current time:1695798142388). 2023-09-27 07:02:22,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:02:22,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x69bd4d48 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:22,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e2e9a9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:22,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:22,401 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:22,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69bd4d48 to 127.0.0.1:53388 2023-09-27 07:02:22,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:22,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x75f8c1bf to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:22,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76ac1545, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:22,410 DEBUG [hconnection-0x67920598-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:22,413 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:22,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:22,419 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47208, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:22,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75f8c1bf to 127.0.0.1:53388 2023-09-27 07:02:22,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:22,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-09-27 07:02:22,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:02:22,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 07:02:22,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 07:02:22,424 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 07:02:22,425 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1695798742425 2023-09-27 07:02:22,425 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-09-27 07:02:22,426 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:02:22,426 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:02:22,427 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-09-27 07:02:22,428 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 07:02:22,428 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 5 msec 2023-09-27 07:02:22,429 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 07:02:22,430 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1695798742430 2023-09-27 07:02:22,441 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,441 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-09-27 07:02:22,441 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:22,443 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-09-27 07:02:22,443 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-09-27 07:02:22,443 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,443 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,446 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,446 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,446 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,446 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,446 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,446 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,446 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,446 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,447 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,447 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:02:22,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,447 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,447 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,448 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 07:02:22,448 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,448 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:22,448 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 07:02:22,450 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 07:02:22,450 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 07:02:22,450 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 07:02:22,448 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-09-27 07:02:22,450 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:22,450 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:22,451 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 07:02:22,452 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-09-27 07:02:22,452 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 07:02:22,452 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 07:02:22,452 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-09-27 07:02:22,453 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-09-27 07:02:22,454 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,454 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:22,454 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:22,455 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,455 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,455 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,455 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,455 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:22,455 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:22,455 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,456 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:22,456 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,456 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:22,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 07:02:22,457 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e5ea60e[Count = 1] remaining members to acquire global barrier 2023-09-27 07:02:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:22,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:22,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-09-27 07:02:22,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e5ea60e[Count = 0] remaining members to acquire global barrier 2023-09-27 07:02:22,459 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-09-27 07:02:22,459 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,462 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 07:02:22,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,462 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,462 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:22,462 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:22,462 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:22,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,462 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 07:02:22,462 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-09-27 07:02:22,462 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,462 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:02:22,462 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:22,462 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:22,462 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. started... 2023-09-27 07:02:22,462 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:22,462 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 07:02:22,462 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:02:22,462 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. started... 2023-09-27 07:02:22,462 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b75a6aa5b4d624d2553d3220a9a17e6e 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-09-27 07:02:22,462 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 2f0a558b6a43d29cc5ae70e5f3465004 1/1 column families, dataSize=333 B heapSize=976 B 2023-09-27 07:02:22,464 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 07:02:22,464 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:22,464 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 07:02:22,485 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927f2c7583e11dd4362a605c0e301883224 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927f2c7583e11dd4362a605c0e301883224 2023-09-27 07:02:22,485 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927731d7f55af5b4fc7b8eb2c175fb954a2 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927731d7f55af5b4fc7b8eb2c175fb954a2 2023-09-27 07:02:22,493 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=2.9 K, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/.tmp/cf/1b8795e43f684833bd9ea29cf0a12520 2023-09-27 07:02:22,493 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=333, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/.tmp/cf/287bf285a1484a5ca16b169b1404a4fd 2023-09-27 07:02:22,498 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/.tmp/cf/287bf285a1484a5ca16b169b1404a4fd as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/cf/287bf285a1484a5ca16b169b1404a4fd 2023-09-27 07:02:22,499 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/.tmp/cf/1b8795e43f684833bd9ea29cf0a12520 as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/cf/1b8795e43f684833bd9ea29cf0a12520 2023-09-27 07:02:22,503 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/cf/287bf285a1484a5ca16b169b1404a4fd, entries=5, sequenceid=6, filesize=5.8 K 2023-09-27 07:02:22,504 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 2f0a558b6a43d29cc5ae70e5f3465004 in 42ms, sequenceid=6, compaction requested=false 2023-09-27 07:02:22,504 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-09-27 07:02:22,505 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2f0a558b6a43d29cc5ae70e5f3465004: 2023-09-27 07:02:22,505 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,505 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:22,505 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/cf/287bf285a1484a5ca16b169b1404a4fd] hfiles 2023-09-27 07:02:22,505 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/cf/287bf285a1484a5ca16b169b1404a4fd for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,509 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/cf/1b8795e43f684833bd9ea29cf0a12520, entries=45, sequenceid=6, filesize=13.2 K 2023-09-27 07:02:22,510 INFO [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for b75a6aa5b4d624d2553d3220a9a17e6e in 48ms, sequenceid=6, compaction requested=false 2023-09-27 07:02:22,512 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b75a6aa5b4d624d2553d3220a9a17e6e: 2023-09-27 07:02:22,512 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,512 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:22,512 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/cf/1b8795e43f684833bd9ea29cf0a12520] hfiles 2023-09-27 07:02:22,512 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/cf/1b8795e43f684833bd9ea29cf0a12520 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,515 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. completed. 2023-09-27 07:02:22,515 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:22,515 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:22,515 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:22,515 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,515 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 07:02:22,515 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:02:22,517 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 07:02:22,517 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,517 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:22,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:22,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:22,517 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 07:02:22,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:22,520 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. completed. 2023-09-27 07:02:22,520 DEBUG [rs(jenkins-hbase4.apache.org,33339,1695798070304)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-09-27 07:02:22,520 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:02:22,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:22,522 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,522 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-09-27 07:02:22,522 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:22,522 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-09-27 07:02:22,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:22,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:02:22,526 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-09-27 07:02:22,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:22,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:22,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:22,527 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 07:02:22,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:02:22,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:22,528 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:02:22,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,33339,1695798070304': 2023-09-27 07:02:22,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-09-27 07:02:22,529 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-09-27 07:02:22,529 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:02:22,529 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:02:22,530 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,530 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:02:22,535 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,535 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,535 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,535 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,535 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,535 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:22,535 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,535 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:22,536 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,536 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:22,538 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,538 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,539 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,541 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,541 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,541 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,541 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,541 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,541 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:22,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,541 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:22,541 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:22,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:22,541 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,542 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,541 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,541 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:22,543 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,543 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:22,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,543 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:22,544 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,544 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,544 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:02:22,544 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,544 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:22,544 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,544 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,544 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927731d7f55af5b4fc7b8eb2c175fb954a2, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927f2c7583e11dd4362a605c0e301883224] mob files 2023-09-27 07:02:22,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927731d7f55af5b4fc7b8eb2c175fb954a2 2023-09-27 07:02:22,545 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927f2c7583e11dd4362a605c0e301883224 2023-09-27 07:02:22,552 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,554 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,573 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,573 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-09-27 07:02:22,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,574 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:22,574 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1695798142425Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1695798142552 (+127 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695798142552Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1695798142552Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1695798142557 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1695798142566 (+9 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1695798142573 (+7 ms) 2023-09-27 07:02:22,577 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-09-27 07:02:22,578 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 151 msec 2023-09-27 07:02:22,728 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:22,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-09-27 07:02:22,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:02:22,757 DEBUG [Listener at jenkins-hbase4.apache.org/36133] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 07:02:22,761 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 07:02:22,763 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33339] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 07:02:22,763 DEBUG [Listener at jenkins-hbase4.apache.org/36133] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 07:02:22,767 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 07:02:22,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40331] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 07:02:22,767 DEBUG [Listener at jenkins-hbase4.apache.org/36133] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-09-27 07:02:22,770 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-09-27 07:02:22,771 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-09-27 07:02:22,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-09-27 07:02:22,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:22,776 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 07:02:22,776 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-09-27 07:02:22,777 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 07:02:22,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 07:02:22,779 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:22,779 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:22,780 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785 empty. 2023-09-27 07:02:22,780 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b empty. 2023-09-27 07:02:22,780 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:22,780 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:22,780 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-27 07:02:22,790 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-09-27 07:02:22,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 28296474c96601631ad7d4c32bc59785, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:02:22,791 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => 31088a137d34629d8a54d75ff1365d9b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:02:22,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:22,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:22,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing 31088a137d34629d8a54d75ff1365d9b, disabling compactions & flushes 2023-09-27 07:02:22,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 28296474c96601631ad7d4c32bc59785, disabling compactions & flushes 2023-09-27 07:02:22,799 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:22,799 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:22,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:22,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:22,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. after waiting 0 ms 2023-09-27 07:02:22,799 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. after waiting 0 ms 2023-09-27 07:02:22,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:22,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:22,800 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:22,800 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:22,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for 31088a137d34629d8a54d75ff1365d9b: 2023-09-27 07:02:22,800 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 28296474c96601631ad7d4c32bc59785: 2023-09-27 07:02:22,802 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 07:02:22,803 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695798142803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798142803"}]},"ts":"1695798142803"} 2023-09-27 07:02:22,803 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695798142803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798142803"}]},"ts":"1695798142803"} 2023-09-27 07:02:22,805 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 07:02:22,806 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 07:02:22,806 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798142806"}]},"ts":"1695798142806"} 2023-09-27 07:02:22,807 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-09-27 07:02:22,810 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 07:02:22,811 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 07:02:22,811 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 07:02:22,811 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 07:02:22,811 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 07:02:22,812 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28296474c96601631ad7d4c32bc59785, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31088a137d34629d8a54d75ff1365d9b, ASSIGN}] 2023-09-27 07:02:22,815 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28296474c96601631ad7d4c32bc59785, ASSIGN 2023-09-27 07:02:22,815 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31088a137d34629d8a54d75ff1365d9b, ASSIGN 2023-09-27 07:02:22,816 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31088a137d34629d8a54d75ff1365d9b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33339,1695798070304; forceNewPlan=false, retain=false 2023-09-27 07:02:22,816 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28296474c96601631ad7d4c32bc59785, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40331,1695798070393; forceNewPlan=false, retain=false 2023-09-27 07:02:22,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 07:02:22,966 INFO [jenkins-hbase4:41725] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 07:02:22,969 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=28296474c96601631ad7d4c32bc59785, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:22,969 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=31088a137d34629d8a54d75ff1365d9b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:22,969 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695798142969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798142969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798142969"}]},"ts":"1695798142969"} 2023-09-27 07:02:22,969 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695798142969"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798142969"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798142969"}]},"ts":"1695798142969"} 2023-09-27 07:02:22,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure 28296474c96601631ad7d4c32bc59785, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:02:22,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=70, ppid=68, state=RUNNABLE; OpenRegionProcedure 31088a137d34629d8a54d75ff1365d9b, server=jenkins-hbase4.apache.org,33339,1695798070304}] 2023-09-27 07:02:23,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 07:02:23,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:23,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:23,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 28296474c96601631ad7d4c32bc59785, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785.', STARTKEY => '', ENDKEY => '2'} 2023-09-27 07:02:23,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 31088a137d34629d8a54d75ff1365d9b, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b.', STARTKEY => '2', ENDKEY => ''} 2023-09-27 07:02:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. service=AccessControlService 2023-09-27 07:02:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. service=AccessControlService 2023-09-27 07:02:23,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:02:23,130 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:02:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:23,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:23,132 INFO [StoreOpener-28296474c96601631ad7d4c32bc59785-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:23,132 INFO [StoreOpener-31088a137d34629d8a54d75ff1365d9b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:23,133 DEBUG [StoreOpener-28296474c96601631ad7d4c32bc59785-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/cf 2023-09-27 07:02:23,133 DEBUG [StoreOpener-31088a137d34629d8a54d75ff1365d9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/cf 2023-09-27 07:02:23,133 DEBUG [StoreOpener-31088a137d34629d8a54d75ff1365d9b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/cf 2023-09-27 07:02:23,133 DEBUG [StoreOpener-28296474c96601631ad7d4c32bc59785-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/cf 2023-09-27 07:02:23,134 INFO [StoreOpener-31088a137d34629d8a54d75ff1365d9b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 31088a137d34629d8a54d75ff1365d9b columnFamilyName cf 2023-09-27 07:02:23,134 INFO [StoreOpener-28296474c96601631ad7d4c32bc59785-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 28296474c96601631ad7d4c32bc59785 columnFamilyName cf 2023-09-27 07:02:23,134 INFO [StoreOpener-31088a137d34629d8a54d75ff1365d9b-1] regionserver.HStore(310): Store=31088a137d34629d8a54d75ff1365d9b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:02:23,134 INFO [StoreOpener-28296474c96601631ad7d4c32bc59785-1] regionserver.HStore(310): Store=28296474c96601631ad7d4c32bc59785/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:02:23,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:23,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:23,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:23,135 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:23,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:23,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:02:23,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 28296474c96601631ad7d4c32bc59785; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67945186, jitterRate=0.01246216893196106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:02:23,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 28296474c96601631ad7d4c32bc59785: 2023-09-27 07:02:23,141 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785., pid=69, masterSystemTime=1695798143123 2023-09-27 07:02:23,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:23,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:23,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:23,145 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=28296474c96601631ad7d4c32bc59785, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:23,146 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695798143145"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798143145"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798143145"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798143145"}]},"ts":"1695798143145"} 2023-09-27 07:02:23,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:02:23,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 31088a137d34629d8a54d75ff1365d9b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66795703, jitterRate=-0.004666462540626526}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:02:23,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 31088a137d34629d8a54d75ff1365d9b: 2023-09-27 07:02:23,149 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b., pid=70, masterSystemTime=1695798143123 2023-09-27 07:02:23,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=69, resume processing ppid=67 2023-09-27 07:02:23,149 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure 28296474c96601631ad7d4c32bc59785, server=jenkins-hbase4.apache.org,40331,1695798070393 in 176 msec 2023-09-27 07:02:23,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:23,150 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:23,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28296474c96601631ad7d4c32bc59785, ASSIGN in 337 msec 2023-09-27 07:02:23,154 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=31088a137d34629d8a54d75ff1365d9b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:23,154 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695798143154"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798143154"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798143154"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798143154"}]},"ts":"1695798143154"} 2023-09-27 07:02:23,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=70, resume processing ppid=68 2023-09-27 07:02:23,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=70, ppid=68, state=SUCCESS; OpenRegionProcedure 31088a137d34629d8a54d75ff1365d9b, server=jenkins-hbase4.apache.org,33339,1695798070304 in 183 msec 2023-09-27 07:02:23,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=68, resume processing ppid=66 2023-09-27 07:02:23,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31088a137d34629d8a54d75ff1365d9b, ASSIGN in 345 msec 2023-09-27 07:02:23,159 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 07:02:23,159 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798143159"}]},"ts":"1695798143159"} 2023-09-27 07:02:23,160 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-09-27 07:02:23,163 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 07:02:23,164 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-09-27 07:02:23,166 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-27 07:02:23,167 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:23,167 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:23,167 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:23,167 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:23,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:23,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:23,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:23,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:23,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:23,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:23,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:23,169 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:23,170 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 395 msec 2023-09-27 07:02:23,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-09-27 07:02:23,382 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-09-27 07:02:23,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 28296474c96601631ad7d4c32bc59785, 31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:23,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[28296474c96601631ad7d4c32bc59785, 31088a137d34629d8a54d75ff1365d9b], force=true 2023-09-27 07:02:23,414 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[28296474c96601631ad7d4c32bc59785, 31088a137d34629d8a54d75ff1365d9b], force=true 2023-09-27 07:02:23,414 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[28296474c96601631ad7d4c32bc59785, 31088a137d34629d8a54d75ff1365d9b], force=true 2023-09-27 07:02:23,414 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[28296474c96601631ad7d4c32bc59785, 31088a137d34629d8a54d75ff1365d9b], force=true 2023-09-27 07:02:23,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 07:02:23,436 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28296474c96601631ad7d4c32bc59785, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31088a137d34629d8a54d75ff1365d9b, UNASSIGN}] 2023-09-27 07:02:23,438 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28296474c96601631ad7d4c32bc59785, UNASSIGN 2023-09-27 07:02:23,438 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31088a137d34629d8a54d75ff1365d9b, UNASSIGN 2023-09-27 07:02:23,439 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=28296474c96601631ad7d4c32bc59785, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:23,439 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695798143439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798143439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798143439"}]},"ts":"1695798143439"} 2023-09-27 07:02:23,439 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=31088a137d34629d8a54d75ff1365d9b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:23,440 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695798143439"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798143439"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798143439"}]},"ts":"1695798143439"} 2023-09-27 07:02:23,441 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure 28296474c96601631ad7d4c32bc59785, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:02:23,441 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure 31088a137d34629d8a54d75ff1365d9b, server=jenkins-hbase4.apache.org,33339,1695798070304}] 2023-09-27 07:02:23,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 07:02:23,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:23,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 28296474c96601631ad7d4c32bc59785, disabling compactions & flushes 2023-09-27 07:02:23,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:23,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:23,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. after waiting 0 ms 2023-09-27 07:02:23,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:23,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 28296474c96601631ad7d4c32bc59785 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-27 07:02:23,595 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:23,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 31088a137d34629d8a54d75ff1365d9b, disabling compactions & flushes 2023-09-27 07:02:23,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:23,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:23,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. after waiting 0 ms 2023-09-27 07:02:23,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:23,597 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 31088a137d34629d8a54d75ff1365d9b 1/1 column families, dataSize=24 B heapSize=352 B 2023-09-27 07:02:23,607 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/.tmp/cf/d9ff3d63cc7e4919962fa766d90c98fe 2023-09-27 07:02:23,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/.tmp/cf/d8fb4c1fe82c490a95737a931c7b0835 2023-09-27 07:02:23,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/.tmp/cf/d9ff3d63cc7e4919962fa766d90c98fe as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/cf/d9ff3d63cc7e4919962fa766d90c98fe 2023-09-27 07:02:23,615 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/.tmp/cf/d8fb4c1fe82c490a95737a931c7b0835 as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/cf/d8fb4c1fe82c490a95737a931c7b0835 2023-09-27 07:02:23,620 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/cf/d8fb4c1fe82c490a95737a931c7b0835, entries=1, sequenceid=5, filesize=4.7 K 2023-09-27 07:02:23,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/cf/d9ff3d63cc7e4919962fa766d90c98fe, entries=1, sequenceid=5, filesize=4.7 K 2023-09-27 07:02:23,621 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 31088a137d34629d8a54d75ff1365d9b in 24ms, sequenceid=5, compaction requested=false 2023-09-27 07:02:23,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 07:02:23,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 28296474c96601631ad7d4c32bc59785 in 27ms, sequenceid=5, compaction requested=false 2023-09-27 07:02:23,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 07:02:23,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-27 07:02:23,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-09-27 07:02:23,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:02:23,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:02:23,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785. 2023-09-27 07:02:23,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b. 2023-09-27 07:02:23,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 28296474c96601631ad7d4c32bc59785: 2023-09-27 07:02:23,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 31088a137d34629d8a54d75ff1365d9b: 2023-09-27 07:02:23,639 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:23,640 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=31088a137d34629d8a54d75ff1365d9b, regionState=CLOSED 2023-09-27 07:02:23,640 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:23,640 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695798143640"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798143640"}]},"ts":"1695798143640"} 2023-09-27 07:02:23,640 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=28296474c96601631ad7d4c32bc59785, regionState=CLOSED 2023-09-27 07:02:23,640 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1695798143640"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798143640"}]},"ts":"1695798143640"} 2023-09-27 07:02:23,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=75, resume processing ppid=73 2023-09-27 07:02:23,643 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure 31088a137d34629d8a54d75ff1365d9b, server=jenkins-hbase4.apache.org,33339,1695798070304 in 200 msec 2023-09-27 07:02:23,643 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=74, resume processing ppid=72 2023-09-27 07:02:23,644 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure 28296474c96601631ad7d4c32bc59785, server=jenkins-hbase4.apache.org,40331,1695798070393 in 201 msec 2023-09-27 07:02:23,644 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=31088a137d34629d8a54d75ff1365d9b, UNASSIGN in 207 msec 2023-09-27 07:02:23,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=72, resume processing ppid=71 2023-09-27 07:02:23,645 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=28296474c96601631ad7d4c32bc59785, UNASSIGN in 211 msec 2023-09-27 07:02:23,688 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-09-27 07:02:23,690 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142772.28296474c96601631ad7d4c32bc59785.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:23,690 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1695798142772.31088a137d34629d8a54d75ff1365d9b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:23,690 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:23,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 07:02:23,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eaba6b36de0e4f21004f03798d85d980, ASSIGN}] 2023-09-27 07:02:23,743 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eaba6b36de0e4f21004f03798d85d980, ASSIGN 2023-09-27 07:02:23,744 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eaba6b36de0e4f21004f03798d85d980, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,40331,1695798070393; forceNewPlan=false, retain=false 2023-09-27 07:02:23,894 INFO [jenkins-hbase4:41725] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-09-27 07:02:23,896 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=eaba6b36de0e4f21004f03798d85d980, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:23,896 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695798143896"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798143896"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798143896"}]},"ts":"1695798143896"} 2023-09-27 07:02:23,898 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure eaba6b36de0e4f21004f03798d85d980, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:02:24,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 07:02:24,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. 2023-09-27 07:02:24,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => eaba6b36de0e4f21004f03798d85d980, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.', STARTKEY => '', ENDKEY => ''} 2023-09-27 07:02:24,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. service=AccessControlService 2023-09-27 07:02:24,053 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:02:24,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:24,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:24,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:24,054 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:24,055 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/.regioninfo 2023-09-27 07:02:24,063 INFO [StoreOpener-eaba6b36de0e4f21004f03798d85d980-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:24,064 DEBUG [StoreOpener-eaba6b36de0e4f21004f03798d85d980-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf 2023-09-27 07:02:24,064 DEBUG [StoreOpener-eaba6b36de0e4f21004f03798d85d980-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf 2023-09-27 07:02:24,064 INFO [StoreOpener-eaba6b36de0e4f21004f03798d85d980-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region eaba6b36de0e4f21004f03798d85d980 columnFamilyName cf 2023-09-27 07:02:24,092 DEBUG [StoreOpener-eaba6b36de0e4f21004f03798d85d980-1] regionserver.HStore(539): loaded hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf/d8fb4c1fe82c490a95737a931c7b0835.31088a137d34629d8a54d75ff1365d9b->hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/cf/d8fb4c1fe82c490a95737a931c7b0835-top 2023-09-27 07:02:24,097 DEBUG [StoreOpener-eaba6b36de0e4f21004f03798d85d980-1] regionserver.HStore(539): loaded hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf/d9ff3d63cc7e4919962fa766d90c98fe.28296474c96601631ad7d4c32bc59785->hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/cf/d9ff3d63cc7e4919962fa766d90c98fe-top 2023-09-27 07:02:24,098 INFO [StoreOpener-eaba6b36de0e4f21004f03798d85d980-1] regionserver.HStore(310): Store=eaba6b36de0e4f21004f03798d85d980/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:02:24,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:24,100 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:24,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:24,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened eaba6b36de0e4f21004f03798d85d980; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69649328, jitterRate=0.03785586357116699}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:02:24,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for eaba6b36de0e4f21004f03798d85d980: 2023-09-27 07:02:24,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980., pid=77, masterSystemTime=1695798144049 2023-09-27 07:02:24,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.,because compaction is disabled. 2023-09-27 07:02:24,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. 2023-09-27 07:02:24,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. 2023-09-27 07:02:24,107 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=eaba6b36de0e4f21004f03798d85d980, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,107 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695798144107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798144107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798144107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798144107"}]},"ts":"1695798144107"} 2023-09-27 07:02:24,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=77, resume processing ppid=76 2023-09-27 07:02:24,110 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure eaba6b36de0e4f21004f03798d85d980, server=jenkins-hbase4.apache.org,40331,1695798070393 in 210 msec 2023-09-27 07:02:24,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=76, resume processing ppid=71 2023-09-27 07:02:24,111 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eaba6b36de0e4f21004f03798d85d980, ASSIGN in 368 msec 2023-09-27 07:02:24,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[28296474c96601631ad7d4c32bc59785, 31088a137d34629d8a54d75ff1365d9b], force=true in 705 msec 2023-09-27 07:02:24,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-09-27 07:02:24,520 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-09-27 07:02:24,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 07:02:24,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798144521 (current time:1695798144521). 2023-09-27 07:02:24,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:02:24,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x17de8500 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:24,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65e2a4d2, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:24,530 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:24,533 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40728, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:24,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17de8500 to 127.0.0.1:53388 2023-09-27 07:02:24,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:24,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x12603177 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:24,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@71f540be, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:24,542 DEBUG [hconnection-0x141be66-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:24,545 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40740, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:24,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:24,551 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47234, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:24,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12603177 to 127.0.0.1:53388 2023-09-27 07:02:24,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:24,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-09-27 07:02:24,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:02:24,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 07:02:24,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 07:02:24,556 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 07:02:24,556 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1695798744556 2023-09-27 07:02:24,556 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-09-27 07:02:24,560 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:02:24,560 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:02:24,560 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 07:02:24,561 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-09-27 07:02:24,562 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 7 msec 2023-09-27 07:02:24,563 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 07:02:24,564 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1695798744564 2023-09-27 07:02:24,577 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,577 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-09-27 07:02:24,577 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:24,579 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-09-27 07:02:24,579 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-09-27 07:02:24,579 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,579 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,581 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:24,581 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:24,581 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:24,581 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:24,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:24,581 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:24,581 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,581 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:02:24,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:24,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:24,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 07:02:24,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,583 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-09-27 07:02:24,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,583 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 07:02:24,583 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 07:02:24,583 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:24,583 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:24,584 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 07:02:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 07:02:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 07:02:24,583 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 07:02:24,586 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-09-27 07:02:24,585 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 07:02:24,586 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 07:02:24,586 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:24,586 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-09-27 07:02:24,587 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-09-27 07:02:24,587 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-09-27 07:02:24,594 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,594 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,594 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,594 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,595 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:24,594 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:24,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:24,595 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,595 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:24,595 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,595 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:24,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:24,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:24,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:24,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:24,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:24,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-09-27 07:02:24,597 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26fc89fb[Count = 0] remaining members to acquire global barrier 2023-09-27 07:02:24,597 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-09-27 07:02:24,597 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,598 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,598 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,598 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,599 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,599 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 07:02:24,598 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,599 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 07:02:24,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,599 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:02:24,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,599 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 07:02:24,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,599 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:02:24,599 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-09-27 07:02:24,599 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 07:02:24,599 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:24,599 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:24,599 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:02:24,599 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. 2023-09-27 07:02:24,599 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. started... 2023-09-27 07:02:24,601 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for eaba6b36de0e4f21004f03798d85d980: 2023-09-27 07:02:24,601 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,601 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:24,601 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf/d8fb4c1fe82c490a95737a931c7b0835.31088a137d34629d8a54d75ff1365d9b->hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/cf/d8fb4c1fe82c490a95737a931c7b0835-top, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf/d9ff3d63cc7e4919962fa766d90c98fe.28296474c96601631ad7d4c32bc59785->hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/cf/d9ff3d63cc7e4919962fa766d90c98fe-top] hfiles 2023-09-27 07:02:24,601 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf/d8fb4c1fe82c490a95737a931c7b0835.31088a137d34629d8a54d75ff1365d9b for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,602 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 07:02:24,602 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:24,602 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 07:02:24,603 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf/d9ff3d63cc7e4919962fa766d90c98fe.28296474c96601631ad7d4c32bc59785 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,604 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 07:02:24,604 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:24,604 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 07:02:24,614 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. completed. 2023-09-27 07:02:24,614 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. 2023-09-27 07:02:24,614 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:24,614 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:24,614 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,614 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-09-27 07:02:24,614 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:02:24,618 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,618 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-09-27 07:02:24,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:24,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:24,618 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:24,619 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-09-27 07:02:24,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:24,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:24,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:24,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:24,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:24,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,40331,1695798070393': 2023-09-27 07:02:24,622 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-09-27 07:02:24,622 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-09-27 07:02:24,622 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:02:24,622 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:02:24,622 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,622 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:02:24,623 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,623 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,623 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,623 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:24,623 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,623 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:24,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,623 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,624 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:24,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:24,624 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,624 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:24,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:24,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,625 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:24,624 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:24,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,625 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:24,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:24,626 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:24,627 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,627 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:24,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:24,631 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:24,631 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,631 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:24,631 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:24,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:24,631 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:24,631 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,631 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:24,631 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,631 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:24,631 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:24,632 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:24,632 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:24,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:24,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:24,631 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:24,631 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:24,632 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:24,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:24,632 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:24,632 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,631 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:24,633 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:24,633 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,633 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:24,633 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,633 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:24,633 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:24,633 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,633 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,633 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:24,634 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:24,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,656 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-09-27 07:02:24,656 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,657 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,657 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1695798144556Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695798144631 (+75 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695798144631Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695798144635 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1695798144648 (+13 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1695798144656 (+8 ms) 2023-09-27 07:02:24,659 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-09-27 07:02:24,660 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:24,661 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 100 msec 2023-09-27 07:02:24,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-09-27 07:02:24,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:02:24,661 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798144661 2023-09-27 07:02:24,662 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35855, tgtDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798144661, rawTgtDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798144661, srcFsUri=hdfs://localhost:35855, srcDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:02:24,690 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:02:24,690 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_2013056740_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798144661, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798144661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,690 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18, snapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-09-27 07:02:24,699 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798144661/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:24,720 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:24,720 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:24,720 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:24,721 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:25,595 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-1488084239092228835.jar 2023-09-27 07:02:25,596 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:25,596 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:25,662 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-8411312363002633002.jar 2023-09-27 07:02:25,663 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:25,663 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:25,664 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:25,664 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:25,665 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:25,665 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:25,665 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 07:02:25,666 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 07:02:25,666 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 07:02:25,666 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 07:02:25,667 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 07:02:25,667 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 07:02:25,667 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 07:02:25,668 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 07:02:25,668 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 07:02:25,669 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 07:02:25,669 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:25,669 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:25,670 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:25,670 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:25,670 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:25,671 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:25,671 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:26,019 WARN [Listener at jenkins-hbase4.apache.org/36133] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 07:02:26,021 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-09-27 07:02:26,024 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-09-27 07:02:26,093 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:02:26,093 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:02:26,101 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0004_000001 (auth:SIMPLE) 2023-09-27 07:02:26,884 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 07:02:27,061 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0005_000001 (auth:SIMPLE) 2023-09-27 07:02:30,786 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0005_000001 (auth:SIMPLE) 2023-09-27 07:02:33,005 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0005_000001 (auth:SIMPLE) 2023-09-27 07:02:35,434 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0005_000001 (auth:SIMPLE) 2023-09-27 07:02:37,192 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 07:02:37,196 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 07:02:37,205 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,205 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 07:02:37,206 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 07:02:37,206 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,206 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-27 07:02:37,206 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-27 07:02:37,206 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798144661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798144661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,207 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798144661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-09-27 07:02:37,207 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798144661/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-09-27 07:02:37,214 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 07:02:37,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798157218"}]},"ts":"1695798157218"} 2023-09-27 07:02:37,220 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-09-27 07:02:37,222 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-09-27 07:02:37,222 INFO [PEWorker-1] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eaba6b36de0e4f21004f03798d85d980, UNASSIGN}] 2023-09-27 07:02:37,224 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eaba6b36de0e4f21004f03798d85d980, UNASSIGN 2023-09-27 07:02:37,225 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=eaba6b36de0e4f21004f03798d85d980, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:37,225 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695798157225"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798157225"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798157225"}]},"ts":"1695798157225"} 2023-09-27 07:02:37,227 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure eaba6b36de0e4f21004f03798d85d980, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:02:37,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 07:02:37,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:37,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing eaba6b36de0e4f21004f03798d85d980, disabling compactions & flushes 2023-09-27 07:02:37,379 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. 2023-09-27 07:02:37,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. 2023-09-27 07:02:37,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. after waiting 0 ms 2023-09-27 07:02:37,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. 2023-09-27 07:02:37,390 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-09-27 07:02:37,391 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:02:37,392 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980. 2023-09-27 07:02:37,392 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for eaba6b36de0e4f21004f03798d85d980: 2023-09-27 07:02:37,393 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:37,394 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=eaba6b36de0e4f21004f03798d85d980, regionState=CLOSED 2023-09-27 07:02:37,394 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1695798157394"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798157394"}]},"ts":"1695798157394"} 2023-09-27 07:02:37,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=82, resume processing ppid=81 2023-09-27 07:02:37,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure eaba6b36de0e4f21004f03798d85d980, server=jenkins-hbase4.apache.org,40331,1695798070393 in 168 msec 2023-09-27 07:02:37,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=81, resume processing ppid=80 2023-09-27 07:02:37,398 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=eaba6b36de0e4f21004f03798d85d980, UNASSIGN in 174 msec 2023-09-27 07:02:37,398 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798157398"}]},"ts":"1695798157398"} 2023-09-27 07:02:37,399 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-09-27 07:02:37,401 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-09-27 07:02:37,402 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 187 msec 2023-09-27 07:02:37,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-09-27 07:02:37,521 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-09-27 07:02:37,522 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,525 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,526 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,527 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,530 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:37,530 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:37,530 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:37,530 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,530 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,530 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,530 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,531 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:37,531 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:37,531 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:37,532 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 07:02:37,532 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 07:02:37,531 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 07:02:37,531 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 07:02:37,532 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 07:02:37,532 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:37,532 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 07:02:37,532 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-09-27 07:02:37,532 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 07:02:37,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-27 07:02:37,533 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/recovered.edits] 2023-09-27 07:02:37,533 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/recovered.edits] 2023-09-27 07:02:37,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:37,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:37,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:37,533 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:37,533 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/recovered.edits] 2023-09-27 07:02:37,537 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/cf/d8fb4c1fe82c490a95737a931c7b0835 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/cf/d8fb4c1fe82c490a95737a931c7b0835 2023-09-27 07:02:37,538 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf/d8fb4c1fe82c490a95737a931c7b0835.31088a137d34629d8a54d75ff1365d9b to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf/d8fb4c1fe82c490a95737a931c7b0835.31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:37,538 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/cf/d9ff3d63cc7e4919962fa766d90c98fe to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/cf/d9ff3d63cc7e4919962fa766d90c98fe 2023-09-27 07:02:37,540 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf/d9ff3d63cc7e4919962fa766d90c98fe.28296474c96601631ad7d4c32bc59785 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/cf/d9ff3d63cc7e4919962fa766d90c98fe.28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:37,541 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/recovered.edits/8.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785/recovered.edits/8.seqid 2023-09-27 07:02:37,541 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/recovered.edits/8.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b/recovered.edits/8.seqid 2023-09-27 07:02:37,542 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/28296474c96601631ad7d4c32bc59785 2023-09-27 07:02:37,542 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/31088a137d34629d8a54d75ff1365d9b 2023-09-27 07:02:37,543 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/recovered.edits/12.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980/recovered.edits/12.seqid 2023-09-27 07:02:37,544 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/eaba6b36de0e4f21004f03798d85d980 2023-09-27 07:02:37,544 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-09-27 07:02:37,546 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,549 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-09-27 07:02:37,551 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-09-27 07:02:37,552 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,552 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-09-27 07:02:37,552 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798157552"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:37,554 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-09-27 07:02:37,554 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => eaba6b36de0e4f21004f03798d85d980, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1695798142773.eaba6b36de0e4f21004f03798d85d980.', STARTKEY => '', ENDKEY => ''}] 2023-09-27 07:02:37,554 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-09-27 07:02:37,554 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695798157554"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:37,555 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-09-27 07:02:37,557 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:37,558 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 35 msec 2023-09-27 07:02:37,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-09-27 07:02:37,634 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-09-27 07:02:37,635 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,635 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 07:02:37,640 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798157639"}]},"ts":"1695798157639"} 2023-09-27 07:02:37,641 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-09-27 07:02:37,642 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-09-27 07:02:37,643 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2f0a558b6a43d29cc5ae70e5f3465004, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b75a6aa5b4d624d2553d3220a9a17e6e, UNASSIGN}] 2023-09-27 07:02:37,645 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2f0a558b6a43d29cc5ae70e5f3465004, UNASSIGN 2023-09-27 07:02:37,645 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b75a6aa5b4d624d2553d3220a9a17e6e, UNASSIGN 2023-09-27 07:02:37,646 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b75a6aa5b4d624d2553d3220a9a17e6e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:37,646 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=2f0a558b6a43d29cc5ae70e5f3465004, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:37,646 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695798157646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798157646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798157646"}]},"ts":"1695798157646"} 2023-09-27 07:02:37,646 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695798157646"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798157646"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798157646"}]},"ts":"1695798157646"} 2023-09-27 07:02:37,648 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 2f0a558b6a43d29cc5ae70e5f3465004, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:02:37,649 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure b75a6aa5b4d624d2553d3220a9a17e6e, server=jenkins-hbase4.apache.org,33339,1695798070304}] 2023-09-27 07:02:37,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 07:02:37,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:37,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2f0a558b6a43d29cc5ae70e5f3465004, disabling compactions & flushes 2023-09-27 07:02:37,800 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:37,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:37,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. after waiting 0 ms 2023-09-27 07:02:37,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:37,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:37,804 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b75a6aa5b4d624d2553d3220a9a17e6e, disabling compactions & flushes 2023-09-27 07:02:37,805 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:37,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:37,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. after waiting 0 ms 2023-09-27 07:02:37,805 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:37,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:02:37,818 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:02:37,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:02:37,819 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:02:37,820 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e. 2023-09-27 07:02:37,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b75a6aa5b4d624d2553d3220a9a17e6e: 2023-09-27 07:02:37,821 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004. 2023-09-27 07:02:37,821 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2f0a558b6a43d29cc5ae70e5f3465004: 2023-09-27 07:02:37,822 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:37,823 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=2f0a558b6a43d29cc5ae70e5f3465004, regionState=CLOSED 2023-09-27 07:02:37,823 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:37,823 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695798157823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798157823"}]},"ts":"1695798157823"} 2023-09-27 07:02:37,823 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=b75a6aa5b4d624d2553d3220a9a17e6e, regionState=CLOSED 2023-09-27 07:02:37,824 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1695798157823"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798157823"}]},"ts":"1695798157823"} 2023-09-27 07:02:37,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=87, resume processing ppid=85 2023-09-27 07:02:37,826 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 2f0a558b6a43d29cc5ae70e5f3465004, server=jenkins-hbase4.apache.org,43767,1695798070355 in 176 msec 2023-09-27 07:02:37,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=88, resume processing ppid=86 2023-09-27 07:02:37,826 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure b75a6aa5b4d624d2553d3220a9a17e6e, server=jenkins-hbase4.apache.org,33339,1695798070304 in 177 msec 2023-09-27 07:02:37,827 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=2f0a558b6a43d29cc5ae70e5f3465004, UNASSIGN in 183 msec 2023-09-27 07:02:37,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=86, resume processing ppid=84 2023-09-27 07:02:37,828 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=b75a6aa5b4d624d2553d3220a9a17e6e, UNASSIGN in 183 msec 2023-09-27 07:02:37,828 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798157828"}]},"ts":"1695798157828"} 2023-09-27 07:02:37,829 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-09-27 07:02:37,832 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-09-27 07:02:37,833 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 197 msec 2023-09-27 07:02:37,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-09-27 07:02:37,942 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-09-27 07:02:37,943 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,946 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,947 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,948 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,950 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,950 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,950 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,950 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 07:02:37,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 07:02:37,951 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-09-27 07:02:37,951 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:37,951 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:37,951 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,951 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,951 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:37,951 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,952 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-09-27 07:02:37,952 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:37,951 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:37,951 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:37,952 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-09-27 07:02:37,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-27 07:02:37,953 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/recovered.edits] 2023-09-27 07:02:37,953 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/recovered.edits] 2023-09-27 07:02:37,957 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/cf/1b8795e43f684833bd9ea29cf0a12520 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/cf/1b8795e43f684833bd9ea29cf0a12520 2023-09-27 07:02:37,957 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/cf/287bf285a1484a5ca16b169b1404a4fd to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/cf/287bf285a1484a5ca16b169b1404a4fd 2023-09-27 07:02:37,960 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e/recovered.edits/9.seqid 2023-09-27 07:02:37,960 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004/recovered.edits/9.seqid 2023-09-27 07:02:37,961 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/b75a6aa5b4d624d2553d3220a9a17e6e 2023-09-27 07:02:37,961 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/2f0a558b6a43d29cc5ae70e5f3465004 2023-09-27 07:02:37,961 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-09-27 07:02:37,961 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-27 07:02:37,962 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-09-27 07:02:37,965 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927731d7f55af5b4fc7b8eb2c175fb954a2 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230927731d7f55af5b4fc7b8eb2c175fb954a2 2023-09-27 07:02:37,966 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927f2c7583e11dd4362a605c0e301883224 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230927f2c7583e11dd4362a605c0e301883224 2023-09-27 07:02:37,967 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-09-27 07:02:37,969 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,971 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-09-27 07:02:37,973 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-09-27 07:02:37,974 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,974 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-09-27 07:02:37,974 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798157974"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:37,974 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798157974"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:37,976 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 07:02:37,976 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2f0a558b6a43d29cc5ae70e5f3465004, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1695798141604.2f0a558b6a43d29cc5ae70e5f3465004.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b75a6aa5b4d624d2553d3220a9a17e6e, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1695798141604.b75a6aa5b4d624d2553d3220a9a17e6e.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 07:02:37,976 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-09-27 07:02:37,976 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695798157976"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:37,977 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-09-27 07:02:37,983 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:37,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 40 msec 2023-09-27 07:02:38,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-09-27 07:02:38,054 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-09-27 07:02:38,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-27 07:02:38,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:38,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-09-27 07:02:38,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-09-27 07:02:38,069 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-09-27 07:02:38,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-09-27 07:02:38,095 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 749) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-28 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1556382651_1 at /127.0.0.1:50504 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:37978 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:37811 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-27 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3960 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:36133 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:50514 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1556382651_1 at /127.0.0.1:59486 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:59504 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=913 (was 903) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 217), ProcessCount=168 (was 168), AvailableMemoryMB=3432 (was 3478) 2023-09-27 07:02:38,096 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-27 07:02:38,116 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=913, MaxFileDescriptor=60000, SystemLoadAverage=181, ProcessCount=168, AvailableMemoryMB=3432 2023-09-27 07:02:38,116 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-09-27 07:02:38,118 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 07:02:38,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 07:02:38,121 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 07:02:38,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-09-27 07:02:38,122 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 07:02:38,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 07:02:38,124 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:38,124 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:38,124 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f empty. 2023-09-27 07:02:38,124 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b empty. 2023-09-27 07:02:38,125 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:38,125 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:38,125 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-27 07:02:38,134 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-09-27 07:02:38,135 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6f37746ceb1ff11c494a2b043f8fa79f, NAME => 'testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:02:38,135 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6116f44132c6c210f6f543a71593635b, NAME => 'testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:02:38,146 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:38,146 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:38,146 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6f37746ceb1ff11c494a2b043f8fa79f, disabling compactions & flushes 2023-09-27 07:02:38,146 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6116f44132c6c210f6f543a71593635b, disabling compactions & flushes 2023-09-27 07:02:38,146 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:38,146 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:38,146 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:38,146 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:38,146 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. after waiting 0 ms 2023-09-27 07:02:38,146 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. after waiting 0 ms 2023-09-27 07:02:38,146 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:38,147 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:38,147 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:38,147 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:38,147 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6116f44132c6c210f6f543a71593635b: 2023-09-27 07:02:38,147 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6f37746ceb1ff11c494a2b043f8fa79f: 2023-09-27 07:02:38,149 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 07:02:38,150 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695798158150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798158150"}]},"ts":"1695798158150"} 2023-09-27 07:02:38,150 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695798158150"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798158150"}]},"ts":"1695798158150"} 2023-09-27 07:02:38,152 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 07:02:38,152 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 07:02:38,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798158153"}]},"ts":"1695798158153"} 2023-09-27 07:02:38,154 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-09-27 07:02:38,156 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 07:02:38,158 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 07:02:38,158 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 07:02:38,158 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 07:02:38,158 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 07:02:38,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f37746ceb1ff11c494a2b043f8fa79f, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6116f44132c6c210f6f543a71593635b, ASSIGN}] 2023-09-27 07:02:38,160 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6116f44132c6c210f6f543a71593635b, ASSIGN 2023-09-27 07:02:38,161 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f37746ceb1ff11c494a2b043f8fa79f, ASSIGN 2023-09-27 07:02:38,161 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6116f44132c6c210f6f543a71593635b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40331,1695798070393; forceNewPlan=false, retain=false 2023-09-27 07:02:38,161 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f37746ceb1ff11c494a2b043f8fa79f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1695798070355; forceNewPlan=false, retain=false 2023-09-27 07:02:38,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 07:02:38,311 INFO [jenkins-hbase4:41725] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 07:02:38,314 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6116f44132c6c210f6f543a71593635b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,314 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6f37746ceb1ff11c494a2b043f8fa79f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,315 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695798158314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798158314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798158314"}]},"ts":"1695798158314"} 2023-09-27 07:02:38,315 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695798158314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798158314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798158314"}]},"ts":"1695798158314"} 2023-09-27 07:02:38,316 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 6116f44132c6c210f6f543a71593635b, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:02:38,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 6f37746ceb1ff11c494a2b043f8fa79f, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:02:38,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 07:02:38,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:38,471 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:38,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6116f44132c6c210f6f543a71593635b, NAME => 'testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 07:02:38,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f37746ceb1ff11c494a2b043f8fa79f, NAME => 'testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 07:02:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. service=AccessControlService 2023-09-27 07:02:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. service=AccessControlService 2023-09-27 07:02:38,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:02:38,472 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:02:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:38,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:38,473 INFO [StoreOpener-6116f44132c6c210f6f543a71593635b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:38,473 INFO [StoreOpener-6f37746ceb1ff11c494a2b043f8fa79f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:38,475 DEBUG [StoreOpener-6116f44132c6c210f6f543a71593635b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/cf 2023-09-27 07:02:38,475 DEBUG [StoreOpener-6116f44132c6c210f6f543a71593635b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/cf 2023-09-27 07:02:38,475 DEBUG [StoreOpener-6f37746ceb1ff11c494a2b043f8fa79f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/cf 2023-09-27 07:02:38,475 DEBUG [StoreOpener-6f37746ceb1ff11c494a2b043f8fa79f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/cf 2023-09-27 07:02:38,475 INFO [StoreOpener-6116f44132c6c210f6f543a71593635b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6116f44132c6c210f6f543a71593635b columnFamilyName cf 2023-09-27 07:02:38,475 INFO [StoreOpener-6f37746ceb1ff11c494a2b043f8fa79f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f37746ceb1ff11c494a2b043f8fa79f columnFamilyName cf 2023-09-27 07:02:38,477 INFO [StoreOpener-6116f44132c6c210f6f543a71593635b-1] regionserver.HStore(310): Store=6116f44132c6c210f6f543a71593635b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:02:38,477 INFO [StoreOpener-6f37746ceb1ff11c494a2b043f8fa79f-1] regionserver.HStore(310): Store=6f37746ceb1ff11c494a2b043f8fa79f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:02:38,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:38,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:38,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:38,478 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:38,480 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:38,481 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:38,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:02:38,482 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f37746ceb1ff11c494a2b043f8fa79f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59806164, jitterRate=-0.10881870985031128}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:02:38,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f37746ceb1ff11c494a2b043f8fa79f: 2023-09-27 07:02:38,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:02:38,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f., pid=94, masterSystemTime=1695798158468 2023-09-27 07:02:38,483 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6116f44132c6c210f6f543a71593635b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68558770, jitterRate=0.02160528302192688}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:02:38,483 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6116f44132c6c210f6f543a71593635b: 2023-09-27 07:02:38,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b., pid=93, masterSystemTime=1695798158468 2023-09-27 07:02:38,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:38,484 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:38,485 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=6f37746ceb1ff11c494a2b043f8fa79f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,485 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695798158485"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798158485"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798158485"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798158485"}]},"ts":"1695798158485"} 2023-09-27 07:02:38,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:38,485 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:38,485 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=6116f44132c6c210f6f543a71593635b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,485 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695798158485"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798158485"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798158485"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798158485"}]},"ts":"1695798158485"} 2023-09-27 07:02:38,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=94, resume processing ppid=91 2023-09-27 07:02:38,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 6f37746ceb1ff11c494a2b043f8fa79f, server=jenkins-hbase4.apache.org,43767,1695798070355 in 169 msec 2023-09-27 07:02:38,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=93, resume processing ppid=92 2023-09-27 07:02:38,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 6116f44132c6c210f6f543a71593635b, server=jenkins-hbase4.apache.org,40331,1695798070393 in 171 msec 2023-09-27 07:02:38,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f37746ceb1ff11c494a2b043f8fa79f, ASSIGN in 330 msec 2023-09-27 07:02:38,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=92, resume processing ppid=90 2023-09-27 07:02:38,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6116f44132c6c210f6f543a71593635b, ASSIGN in 330 msec 2023-09-27 07:02:38,490 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 07:02:38,490 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798158490"}]},"ts":"1695798158490"} 2023-09-27 07:02:38,491 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-09-27 07:02:38,493 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 07:02:38,494 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-09-27 07:02:38,495 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 07:02:38,497 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:38,497 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:38,497 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:38,497 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:38,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:38,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:38,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:38,499 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:38,500 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 381 msec 2023-09-27 07:02:38,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-09-27 07:02:38,726 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-09-27 07:02:38,728 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-27 07:02:38,728 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:38,730 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:02:38,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:02:38,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798158741 (current time:1695798158741). 2023-09-27 07:02:38,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:02:38,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x0cbd5715 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:38,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@66fb1094, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:38,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:38,754 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43290, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:38,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cbd5715 to 127.0.0.1:53388 2023-09-27 07:02:38,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:38,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x1cfbd402 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:38,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a183d77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:38,766 DEBUG [hconnection-0x4459fd10-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:38,768 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43298, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:38,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:38,774 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:38,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1cfbd402 to 127.0.0.1:53388 2023-09-27 07:02:38,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:38,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 07:02:38,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:02:38,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:02:38,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:02:38,779 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:02:38,780 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695798758780 2023-09-27 07:02:38,780 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-27 07:02:38,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:02:38,781 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:02:38,781 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:02:38,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 07:02:38,782 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:02:38,783 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 4 msec 2023-09-27 07:02:38,786 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 07:02:38,787 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695798758787 2023-09-27 07:02:38,796 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,796 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-09-27 07:02:38,796 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:38,797 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-27 07:02:38,797 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-27 07:02:38,798 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,798 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,803 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:38,803 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:38,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:38,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:38,803 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,803 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:38,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:38,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:38,804 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,804 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,804 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,804 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:02:38,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,805 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 07:02:38,805 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 07:02:38,805 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:38,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,807 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 07:02:38,807 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 07:02:38,807 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 07:02:38,805 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:38,807 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:38,807 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 07:02:38,809 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 07:02:38,808 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 07:02:38,809 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 07:02:38,809 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 07:02:38,810 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 07:02:38,810 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 07:02:38,811 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,811 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:38,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:38,812 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,813 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,813 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,813 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,813 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:38,813 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,813 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:38,813 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,813 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:38,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:38,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 07:02:38,815 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fab92d8[Count = 1] remaining members to acquire global barrier 2023-09-27 07:02:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:38,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:38,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 07:02:38,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1fab92d8[Count = 0] remaining members to acquire global barrier 2023-09-27 07:02:38,817 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 07:02:38,818 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,820 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,820 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,820 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:02:38,821 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:02:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:02:38,821 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:38,821 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:38,821 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,821 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. started... 2023-09-27 07:02:38,821 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. started... 2023-09-27 07:02:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 07:02:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:02:38,821 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:02:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:38,821 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:38,823 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6116f44132c6c210f6f543a71593635b: 2023-09-27 07:02:38,821 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f37746ceb1ff11c494a2b043f8fa79f: 2023-09-27 07:02:38,823 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,823 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,823 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:38,823 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:38,823 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:02:38,823 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:02:38,824 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 07:02:38,824 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:38,824 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 07:02:38,837 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. completed. 2023-09-27 07:02:38,837 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:38,837 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:38,837 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:38,837 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,837 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 07:02:38,837 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:02:38,839 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,839 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 07:02:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:38,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:38,839 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:38,839 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. completed. 2023-09-27 07:02:38,839 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 07:02:38,841 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:38,841 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:38,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:38,841 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:38,841 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,841 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 07:02:38,841 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:02:38,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:38,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,842 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,843 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 07:02:38,843 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,843 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:38,843 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 07:02:38,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:02:38,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 07:02:38,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:38,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:38,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:38,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:38,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,847 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:38,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40331,1695798070393': 2023-09-27 07:02:38,849 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 07:02:38,849 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-09-27 07:02:38,849 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:02:38,849 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:02:38,849 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,849 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:02:38,852 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,852 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:38,852 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:38,852 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,852 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,852 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,852 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,852 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,852 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:38,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:38,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:38,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:38,853 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,853 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,853 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:38,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,854 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,855 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:38,855 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,855 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,858 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:38,858 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:38,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:38,858 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:38,858 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,858 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:38,858 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,858 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:38,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:38,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,858 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:38,858 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,858 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:38,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:38,858 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:38,858 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:38,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:38,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:38,859 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,858 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-27 07:02:38,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:38,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:38,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:38,860 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:38,860 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,860 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,861 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:38,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:02:38,862 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:38,862 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,862 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:38,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:38,862 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,863 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 07:02:38,869 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,870 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,881 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:38,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 07:02:38,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:02:38,883 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:02:38,896 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,897 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-27 07:02:38,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,897 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:38,897 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695798158780Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695798158869 (+89 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695798158869Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1695798158870 (+1 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1695798158875 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1695798158891 (+16 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695798158897 (+6 ms) 2023-09-27 07:02:38,901 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 07:02:38,902 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 120 msec 2023-09-27 07:02:39,083 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:39,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 07:02:39,084 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:02:39,086 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:02:39,087 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40331] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:02:39,090 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-09-27 07:02:39,090 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:39,090 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:02:39,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:02:39,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798159099 (current time:1695798159099). 2023-09-27 07:02:39,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:02:39,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x7742759c to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:39,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c78b719, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:39,108 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:39,111 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:39,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7742759c to 127.0.0.1:53388 2023-09-27 07:02:39,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:39,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x729f72e7 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:39,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@161507bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:39,120 DEBUG [hconnection-0x2fecba19-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:39,121 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:39,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:39,126 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:39,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x729f72e7 to 127.0.0.1:53388 2023-09-27 07:02:39,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:39,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-09-27 07:02:39,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:02:39,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:02:39,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:02:39,130 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:02:39,131 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1695798759131 2023-09-27 07:02:39,131 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-09-27 07:02:39,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-09-27 07:02:39,133 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:02:39,133 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:02:39,134 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 07:02:39,134 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-09-27 07:02:39,135 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 5 msec 2023-09-27 07:02:39,135 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 07:02:39,136 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1695798759136 2023-09-27 07:02:39,144 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,144 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-09-27 07:02:39,144 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:39,145 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-09-27 07:02:39,145 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-09-27 07:02:39,146 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,146 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,147 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:39,147 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:39,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:39,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:39,147 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,147 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:39,147 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:39,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:39,148 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,148 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,148 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,148 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,148 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 07:02:39,149 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-09-27 07:02:39,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,149 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 07:02:39,149 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,149 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:39,149 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 07:02:39,150 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 07:02:39,150 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 07:02:39,149 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-09-27 07:02:39,150 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:39,150 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 07:02:39,150 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:39,151 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 07:02:39,154 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 07:02:39,154 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-09-27 07:02:39,154 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-09-27 07:02:39,154 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 07:02:39,154 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-09-27 07:02:39,156 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,159 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,159 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:39,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:39,161 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,161 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:39,161 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,161 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:39,161 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,161 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:39,161 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,161 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:39,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:39,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 07:02:39,163 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fa419b6[Count = 1] remaining members to acquire global barrier 2023-09-27 07:02:39,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:39,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:39,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:39,163 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:39,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:39,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-09-27 07:02:39,165 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@fa419b6[Count = 0] remaining members to acquire global barrier 2023-09-27 07:02:39,165 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-09-27 07:02:39,165 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,169 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,169 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,169 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,169 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:02:39,169 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:02:39,169 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-09-27 07:02:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 07:02:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:02:39,169 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:39,169 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. started... 2023-09-27 07:02:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:39,169 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:39,169 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:39,170 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:39,170 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6f37746ceb1ff11c494a2b043f8fa79f 1/1 column families, dataSize=266 B heapSize=832 B 2023-09-27 07:02:39,169 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,170 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:02:39,170 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. started... 2023-09-27 07:02:39,170 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6116f44132c6c210f6f543a71593635b 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-09-27 07:02:39,172 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 07:02:39,172 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:39,172 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 07:02:39,218 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202309271995c04c108c46b8a978877b0ff6766a to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309271995c04c108c46b8a978877b0ff6766a 2023-09-27 07:02:39,218 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230927fddb40682ce742d9ab24b25d84095f05 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927fddb40682ce742d9ab24b25d84095f05 2023-09-27 07:02:39,232 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=266, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/.tmp/cf/6937675b4d6e4e5298ebc46156279b5d 2023-09-27 07:02:39,232 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.0 K, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/.tmp/cf/642b8449ee244bc39a0a8e4748bdb30f 2023-09-27 07:02:39,234 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:39,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 07:02:39,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:02:39,235 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:02:39,237 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/.tmp/cf/642b8449ee244bc39a0a8e4748bdb30f as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/cf/642b8449ee244bc39a0a8e4748bdb30f 2023-09-27 07:02:39,237 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/.tmp/cf/6937675b4d6e4e5298ebc46156279b5d as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/cf/6937675b4d6e4e5298ebc46156279b5d 2023-09-27 07:02:39,242 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/cf/6937675b4d6e4e5298ebc46156279b5d, entries=4, sequenceid=6, filesize=5.6 K 2023-09-27 07:02:39,242 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/cf/642b8449ee244bc39a0a8e4748bdb30f, entries=46, sequenceid=6, filesize=12.9 K 2023-09-27 07:02:39,243 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 6f37746ceb1ff11c494a2b043f8fa79f in 73ms, sequenceid=6, compaction requested=false 2023-09-27 07:02:39,243 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-27 07:02:39,243 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 6116f44132c6c210f6f543a71593635b in 73ms, sequenceid=6, compaction requested=false 2023-09-27 07:02:39,243 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-09-27 07:02:39,246 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6f37746ceb1ff11c494a2b043f8fa79f: 2023-09-27 07:02:39,246 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6116f44132c6c210f6f543a71593635b: 2023-09-27 07:02:39,246 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,246 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,247 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:39,247 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:39,247 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/cf/6937675b4d6e4e5298ebc46156279b5d] hfiles 2023-09-27 07:02:39,247 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/cf/642b8449ee244bc39a0a8e4748bdb30f] hfiles 2023-09-27 07:02:39,247 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/cf/6937675b4d6e4e5298ebc46156279b5d for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,247 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/cf/642b8449ee244bc39a0a8e4748bdb30f for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,261 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. completed. 2023-09-27 07:02:39,261 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 07:02:39,261 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:02:39,263 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 07:02:39,263 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,263 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,263 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 07:02:39,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:39,265 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. completed. 2023-09-27 07:02:39,265 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:39,265 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:39,265 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:39,265 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:39,265 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-09-27 07:02:39,265 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:02:39,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,267 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,267 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-09-27 07:02:39,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,267 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:39,267 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-09-27 07:02:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,40331,1695798070393': 2023-09-27 07:02:39,270 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-09-27 07:02:39,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:39,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:39,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:02:39,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-09-27 07:02:39,273 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-09-27 07:02:39,273 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:02:39,273 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:02:39,273 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,273 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:02:39,275 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,275 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,275 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,275 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,275 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:39,275 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:39,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:39,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:39,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,275 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,276 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:39,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:39,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:39,276 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:39,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,277 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:39,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,278 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:39,279 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,279 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,280 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:39,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:39,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:39,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:39,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:39,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:39,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:39,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:39,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:39,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:39,283 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,283 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:39,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:39,284 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-09-27 07:02:39,283 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:39,283 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:39,285 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:39,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:39,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:02:39,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:39,285 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,286 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,286 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:39,286 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,286 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:39,286 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:39,286 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,286 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309271995c04c108c46b8a978877b0ff6766a, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927fddb40682ce742d9ab24b25d84095f05] mob files 2023-09-27 07:02:39,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309271995c04c108c46b8a978877b0ff6766a 2023-09-27 07:02:39,286 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927fddb40682ce742d9ab24b25d84095f05 2023-09-27 07:02:39,293 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,294 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,316 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-09-27 07:02:39,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,317 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,317 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1695798159131Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1695798159293 (+162 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1695798159293Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1695798159293Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1695798159297 (+4 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1695798159306 (+9 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1695798159317 (+11 ms) 2023-09-27 07:02:39,322 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-09-27 07:02:39,323 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 190 msec 2023-09-27 07:02:39,435 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:39,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-09-27 07:02:39,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:02:39,437 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798159437 2023-09-27 07:02:39,437 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35855, tgtDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798159437, rawTgtDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798159437, srcFsUri=hdfs://localhost:35855, srcDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:02:39,460 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:02:39,460 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1262225059_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798159437, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798159437/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,460 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18, snapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-09-27 07:02:39,465 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798159437/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:39,487 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:39,487 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:39,488 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:39,488 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:40,357 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-4140807464452887910.jar 2023-09-27 07:02:40,358 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:40,358 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:40,424 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-5120075737679543288.jar 2023-09-27 07:02:40,424 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:40,425 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:40,425 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:40,425 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:40,426 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:40,426 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:40,426 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 07:02:40,427 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 07:02:40,427 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 07:02:40,427 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 07:02:40,428 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 07:02:40,428 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 07:02:40,429 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 07:02:40,429 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 07:02:40,429 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 07:02:40,430 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 07:02:40,430 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:40,431 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:40,431 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:40,431 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:40,432 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:40,432 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:40,433 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:40,770 WARN [Listener at jenkins-hbase4.apache.org/36133] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 07:02:40,772 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-09-27 07:02:41,607 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:02:41,607 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:02:41,609 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0005_000001 (auth:SIMPLE) 2023-09-27 07:02:42,111 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0006_000001 (auth:SIMPLE) 2023-09-27 07:02:42,978 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 07:02:45,992 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0006_000001 (auth:SIMPLE) 2023-09-27 07:02:49,117 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 07:02:49,118 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 07:02:49,133 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:49,133 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 07:02:49,134 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 07:02:49,134 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:49,134 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-27 07:02:49,134 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-27 07:02:49,135 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798159437/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798159437/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:49,135 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798159437/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-09-27 07:02:49,135 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798159437/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-09-27 07:02:49,141 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,141 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 07:02:49,145 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798169145"}]},"ts":"1695798169145"} 2023-09-27 07:02:49,147 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-09-27 07:02:49,148 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-09-27 07:02:49,149 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f37746ceb1ff11c494a2b043f8fa79f, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6116f44132c6c210f6f543a71593635b, UNASSIGN}] 2023-09-27 07:02:49,151 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f37746ceb1ff11c494a2b043f8fa79f, UNASSIGN 2023-09-27 07:02:49,151 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6116f44132c6c210f6f543a71593635b, UNASSIGN 2023-09-27 07:02:49,152 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6f37746ceb1ff11c494a2b043f8fa79f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:49,152 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6116f44132c6c210f6f543a71593635b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:49,152 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695798169152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798169152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798169152"}]},"ts":"1695798169152"} 2023-09-27 07:02:49,152 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695798169152"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798169152"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798169152"}]},"ts":"1695798169152"} 2023-09-27 07:02:49,153 INFO [PEWorker-2] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=102, ppid=100, state=RUNNABLE; CloseRegionProcedure 6f37746ceb1ff11c494a2b043f8fa79f, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:02:49,154 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=103, ppid=101, state=RUNNABLE; CloseRegionProcedure 6116f44132c6c210f6f543a71593635b, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:02:49,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 07:02:49,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:49,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:49,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6116f44132c6c210f6f543a71593635b, disabling compactions & flushes 2023-09-27 07:02:49,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f37746ceb1ff11c494a2b043f8fa79f, disabling compactions & flushes 2023-09-27 07:02:49,305 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:49,306 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:49,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:49,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:49,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. after waiting 0 ms 2023-09-27 07:02:49,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:49,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. after waiting 0 ms 2023-09-27 07:02:49,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:49,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:02:49,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:02:49,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:02:49,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:02:49,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b. 2023-09-27 07:02:49,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f. 2023-09-27 07:02:49,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6116f44132c6c210f6f543a71593635b: 2023-09-27 07:02:49,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f37746ceb1ff11c494a2b043f8fa79f: 2023-09-27 07:02:49,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:49,318 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=6f37746ceb1ff11c494a2b043f8fa79f, regionState=CLOSED 2023-09-27 07:02:49,319 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695798169318"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798169318"}]},"ts":"1695798169318"} 2023-09-27 07:02:49,319 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:49,321 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=6116f44132c6c210f6f543a71593635b, regionState=CLOSED 2023-09-27 07:02:49,321 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1695798169321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798169321"}]},"ts":"1695798169321"} 2023-09-27 07:02:49,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=102, resume processing ppid=100 2023-09-27 07:02:49,322 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=102, ppid=100, state=SUCCESS; CloseRegionProcedure 6f37746ceb1ff11c494a2b043f8fa79f, server=jenkins-hbase4.apache.org,43767,1695798070355 in 167 msec 2023-09-27 07:02:49,324 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6f37746ceb1ff11c494a2b043f8fa79f, UNASSIGN in 173 msec 2023-09-27 07:02:49,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=103, resume processing ppid=101 2023-09-27 07:02:49,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=103, ppid=101, state=SUCCESS; CloseRegionProcedure 6116f44132c6c210f6f543a71593635b, server=jenkins-hbase4.apache.org,40331,1695798070393 in 168 msec 2023-09-27 07:02:49,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=101, resume processing ppid=99 2023-09-27 07:02:49,326 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=6116f44132c6c210f6f543a71593635b, UNASSIGN in 175 msec 2023-09-27 07:02:49,327 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798169327"}]},"ts":"1695798169327"} 2023-09-27 07:02:49,328 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-09-27 07:02:49,330 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-09-27 07:02:49,332 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 189 msec 2023-09-27 07:02:49,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-09-27 07:02:49,448 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-09-27 07:02:49,449 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,452 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,453 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,455 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,458 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,458 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,458 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,458 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:49,458 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:49,459 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 07:02:49,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 07:02:49,459 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 07:02:49,460 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-09-27 07:02:49,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:49,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:49,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:49,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,461 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:49,461 DEBUG [HFileArchiver-18] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/recovered.edits] 2023-09-27 07:02:49,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-27 07:02:49,463 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/recovered.edits] 2023-09-27 07:02:49,466 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/cf/6937675b4d6e4e5298ebc46156279b5d to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/cf/6937675b4d6e4e5298ebc46156279b5d 2023-09-27 07:02:49,467 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/cf/642b8449ee244bc39a0a8e4748bdb30f to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/cf/642b8449ee244bc39a0a8e4748bdb30f 2023-09-27 07:02:49,470 DEBUG [HFileArchiver-18] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f/recovered.edits/9.seqid 2023-09-27 07:02:49,470 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b/recovered.edits/9.seqid 2023-09-27 07:02:49,471 DEBUG [HFileArchiver-18] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6f37746ceb1ff11c494a2b043f8fa79f 2023-09-27 07:02:49,471 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testEmptyExportFileSystemState/6116f44132c6c210f6f543a71593635b 2023-09-27 07:02:49,471 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-09-27 07:02:49,471 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-27 07:02:49,472 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-09-27 07:02:49,475 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309271995c04c108c46b8a978877b0ff6766a to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202309271995c04c108c46b8a978877b0ff6766a 2023-09-27 07:02:49,477 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927fddb40682ce742d9ab24b25d84095f05 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e20230927fddb40682ce742d9ab24b25d84095f05 2023-09-27 07:02:49,477 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-09-27 07:02:49,479 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,482 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-09-27 07:02:49,484 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-09-27 07:02:49,485 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,485 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-09-27 07:02:49,485 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798169485"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:49,485 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798169485"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:49,487 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 07:02:49,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6f37746ceb1ff11c494a2b043f8fa79f, NAME => 'testtb-testEmptyExportFileSystemState,,1695798158117.6f37746ceb1ff11c494a2b043f8fa79f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6116f44132c6c210f6f543a71593635b, NAME => 'testtb-testEmptyExportFileSystemState,1,1695798158117.6116f44132c6c210f6f543a71593635b.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 07:02:49,487 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-09-27 07:02:49,487 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695798169487"}]},"ts":"9223372036854775807"} 2023-09-27 07:02:49,489 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-09-27 07:02:49,490 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-09-27 07:02:49,491 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 41 msec 2023-09-27 07:02:49,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-09-27 07:02:49,563 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-09-27 07:02:49,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-09-27 07:02:49,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:49,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-09-27 07:02:49,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-09-27 07:02:49,604 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 758) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1846974837_1 at /127.0.0.1:45006 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:33791 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:51064 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:45030 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:34835 from appattempt_1695798076919_0005_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1846974837_1 at /127.0.0.1:50928 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:41723 from appattempt_1695798076919_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_574925102_17 at /127.0.0.1:58836 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-4613 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=927 (was 913) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=177 (was 181), ProcessCount=168 (was 168), AvailableMemoryMB=3412 (was 3432) 2023-09-27 07:02:49,604 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-27 07:02:49,624 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=927, MaxFileDescriptor=60000, SystemLoadAverage=177, ProcessCount=168, AvailableMemoryMB=3410 2023-09-27 07:02:49,624 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-09-27 07:02:49,626 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-09-27 07:02:49,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:49,629 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-09-27 07:02:49,630 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-09-27 07:02:49,630 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-09-27 07:02:49,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 07:02:49,633 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:02:49,633 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50 2023-09-27 07:02:49,633 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6 empty. 2023-09-27 07:02:49,633 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50 empty. 2023-09-27 07:02:49,633 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:02:49,633 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50 2023-09-27 07:02:49,634 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-27 07:02:49,645 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-09-27 07:02:49,646 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => a66dd71169a0b09d53d1565a213196e6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:02:49,647 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => f710333f7796a83d329876971c1bde50, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp 2023-09-27 07:02:49,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:49,668 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing f710333f7796a83d329876971c1bde50, disabling compactions & flushes 2023-09-27 07:02:49,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:49,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:49,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:49,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. after waiting 0 ms 2023-09-27 07:02:49,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing a66dd71169a0b09d53d1565a213196e6, disabling compactions & flushes 2023-09-27 07:02:49,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:49,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:49,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:49,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:49,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for f710333f7796a83d329876971c1bde50: 2023-09-27 07:02:49,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. after waiting 0 ms 2023-09-27 07:02:49,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:49,669 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:49,669 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for a66dd71169a0b09d53d1565a213196e6: 2023-09-27 07:02:49,671 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-09-27 07:02:49,672 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695798169672"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798169672"}]},"ts":"1695798169672"} 2023-09-27 07:02:49,672 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695798169672"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798169672"}]},"ts":"1695798169672"} 2023-09-27 07:02:49,674 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-09-27 07:02:49,675 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-09-27 07:02:49,675 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798169675"}]},"ts":"1695798169675"} 2023-09-27 07:02:49,676 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-09-27 07:02:49,679 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-09-27 07:02:49,680 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-09-27 07:02:49,680 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-09-27 07:02:49,681 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-09-27 07:02:49,681 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-09-27 07:02:49,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a66dd71169a0b09d53d1565a213196e6, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f710333f7796a83d329876971c1bde50, ASSIGN}] 2023-09-27 07:02:49,683 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f710333f7796a83d329876971c1bde50, ASSIGN 2023-09-27 07:02:49,683 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a66dd71169a0b09d53d1565a213196e6, ASSIGN 2023-09-27 07:02:49,684 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f710333f7796a83d329876971c1bde50, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40331,1695798070393; forceNewPlan=false, retain=false 2023-09-27 07:02:49,684 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a66dd71169a0b09d53d1565a213196e6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43767,1695798070355; forceNewPlan=false, retain=false 2023-09-27 07:02:49,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 07:02:49,834 INFO [jenkins-hbase4:41725] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-09-27 07:02:49,837 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a66dd71169a0b09d53d1565a213196e6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:49,837 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f710333f7796a83d329876971c1bde50, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:49,837 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695798169837"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798169837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798169837"}]},"ts":"1695798169837"} 2023-09-27 07:02:49,837 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695798169837"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798169837"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798169837"}]},"ts":"1695798169837"} 2023-09-27 07:02:49,839 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=108, ppid=106, state=RUNNABLE; OpenRegionProcedure a66dd71169a0b09d53d1565a213196e6, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:02:49,840 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=109, ppid=107, state=RUNNABLE; OpenRegionProcedure f710333f7796a83d329876971c1bde50, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:02:49,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 07:02:49,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:49,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f710333f7796a83d329876971c1bde50, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.', STARTKEY => '1', ENDKEY => ''} 2023-09-27 07:02:49,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. service=AccessControlService 2023-09-27 07:02:49,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:02:49,994 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:49,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp f710333f7796a83d329876971c1bde50 2023-09-27 07:02:49,994 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a66dd71169a0b09d53d1565a213196e6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.', STARTKEY => '', ENDKEY => '1'} 2023-09-27 07:02:49,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:49,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f710333f7796a83d329876971c1bde50 2023-09-27 07:02:49,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f710333f7796a83d329876971c1bde50 2023-09-27 07:02:49,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. service=AccessControlService 2023-09-27 07:02:49,995 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-09-27 07:02:49,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:02:49,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-09-27 07:02:49,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:02:49,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:02:49,996 INFO [StoreOpener-f710333f7796a83d329876971c1bde50-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f710333f7796a83d329876971c1bde50 2023-09-27 07:02:49,996 INFO [StoreOpener-a66dd71169a0b09d53d1565a213196e6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:02:49,997 DEBUG [StoreOpener-f710333f7796a83d329876971c1bde50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/cf 2023-09-27 07:02:49,997 DEBUG [StoreOpener-f710333f7796a83d329876971c1bde50-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/cf 2023-09-27 07:02:49,998 DEBUG [StoreOpener-a66dd71169a0b09d53d1565a213196e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/cf 2023-09-27 07:02:49,998 DEBUG [StoreOpener-a66dd71169a0b09d53d1565a213196e6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/cf 2023-09-27 07:02:49,998 INFO [StoreOpener-f710333f7796a83d329876971c1bde50-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f710333f7796a83d329876971c1bde50 columnFamilyName cf 2023-09-27 07:02:49,998 INFO [StoreOpener-a66dd71169a0b09d53d1565a213196e6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a66dd71169a0b09d53d1565a213196e6 columnFamilyName cf 2023-09-27 07:02:49,999 INFO [StoreOpener-f710333f7796a83d329876971c1bde50-1] regionserver.HStore(310): Store=f710333f7796a83d329876971c1bde50/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:02:49,999 INFO [StoreOpener-a66dd71169a0b09d53d1565a213196e6-1] regionserver.HStore(310): Store=a66dd71169a0b09d53d1565a213196e6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-09-27 07:02:50,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50 2023-09-27 07:02:50,000 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:02:50,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50 2023-09-27 07:02:50,001 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:02:50,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f710333f7796a83d329876971c1bde50 2023-09-27 07:02:50,003 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:02:50,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:02:50,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-09-27 07:02:50,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a66dd71169a0b09d53d1565a213196e6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68480438, jitterRate=0.020438045263290405}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:02:50,005 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f710333f7796a83d329876971c1bde50; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71223430, jitterRate=0.061311811208724976}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-09-27 07:02:50,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a66dd71169a0b09d53d1565a213196e6: 2023-09-27 07:02:50,005 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f710333f7796a83d329876971c1bde50: 2023-09-27 07:02:50,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6., pid=108, masterSystemTime=1695798169991 2023-09-27 07:02:50,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50., pid=109, masterSystemTime=1695798169991 2023-09-27 07:02:50,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:50,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:50,008 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=a66dd71169a0b09d53d1565a213196e6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,008 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:50,008 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695798170008"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798170008"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798170008"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798170008"}]},"ts":"1695798170008"} 2023-09-27 07:02:50,008 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:50,009 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=f710333f7796a83d329876971c1bde50, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,009 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695798170009"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1695798170009"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1695798170009"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1695798170009"}]},"ts":"1695798170009"} 2023-09-27 07:02:50,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=108, resume processing ppid=106 2023-09-27 07:02:50,011 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=108, ppid=106, state=SUCCESS; OpenRegionProcedure a66dd71169a0b09d53d1565a213196e6, server=jenkins-hbase4.apache.org,43767,1695798070355 in 171 msec 2023-09-27 07:02:50,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=109, resume processing ppid=107 2023-09-27 07:02:50,012 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=109, ppid=107, state=SUCCESS; OpenRegionProcedure f710333f7796a83d329876971c1bde50, server=jenkins-hbase4.apache.org,40331,1695798070393 in 171 msec 2023-09-27 07:02:50,013 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a66dd71169a0b09d53d1565a213196e6, ASSIGN in 330 msec 2023-09-27 07:02:50,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=107, resume processing ppid=105 2023-09-27 07:02:50,014 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f710333f7796a83d329876971c1bde50, ASSIGN in 332 msec 2023-09-27 07:02:50,015 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-09-27 07:02:50,015 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798170015"}]},"ts":"1695798170015"} 2023-09-27 07:02:50,016 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-09-27 07:02:50,018 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-09-27 07:02:50,019 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-09-27 07:02:50,020 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 07:02:50,022 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:50,022 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:50,022 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:50,022 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:02:50,023 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:50,023 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:50,023 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:50,024 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-09-27 07:02:50,025 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 398 msec 2023-09-27 07:02:50,234 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-09-27 07:02:50,234 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-09-27 07:02:50,236 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,237 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:50,238 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:02:50,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 07:02:50,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798170248 (current time:1695798170248). 2023-09-27 07:02:50,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:02:50,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x3ff2a833 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:50,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b7649b1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:50,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:50,260 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:50,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3ff2a833 to 127.0.0.1:53388 2023-09-27 07:02:50,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:50,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x280e4863 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:50,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@217de61, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:50,268 DEBUG [hconnection-0x5b752453-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:50,271 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37366, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:50,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:50,277 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:50,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x280e4863 to 127.0.0.1:53388 2023-09-27 07:02:50,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:50,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 07:02:50,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:02:50,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 07:02:50,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 07:02:50,282 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 07:02:50,282 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695798770282 2023-09-27 07:02:50,282 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 07:02:50,283 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:02:50,284 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:02:50,284 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 07:02:50,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 07:02:50,289 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-27 07:02:50,290 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 07:02:50,290 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695798770290 2023-09-27 07:02:50,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,298 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-27 07:02:50,298 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:50,300 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-27 07:02:50,300 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-27 07:02:50,300 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,300 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,302 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:50,302 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:50,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:50,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:50,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:50,302 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,302 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:50,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:50,302 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:50,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:50,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,303 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,303 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,303 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,303 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:02:50,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 07:02:50,303 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 07:02:50,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 07:02:50,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 07:02:50,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-09-27 07:02:50,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,304 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,304 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 07:02:50,304 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 07:02:50,304 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:50,305 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 07:02:50,305 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 07:02:50,305 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 07:02:50,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,305 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 07:02:50,305 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 07:02:50,305 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:50,305 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:50,307 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 07:02:50,307 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 07:02:50,308 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 07:02:50,308 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 07:02:50,308 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 07:02:50,308 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 07:02:50,313 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,314 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,314 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,314 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,314 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,314 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,314 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,314 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:50,314 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,314 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:50,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:50,314 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,315 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:50,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 07:02:50,316 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@441a09a[Count = 1] remaining members to acquire global barrier 2023-09-27 07:02:50,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:50,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:50,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:50,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:50,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:50,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 07:02:50,318 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@441a09a[Count = 0] remaining members to acquire global barrier 2023-09-27 07:02:50,318 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-27 07:02:50,318 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,320 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,320 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,320 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,320 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 07:02:50,320 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,320 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:50,320 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 07:02:50,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,320 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:50,320 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 07:02:50,321 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. started... 2023-09-27 07:02:50,321 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:50,321 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:50,321 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:02:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 07:02:50,320 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:50,321 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:02:50,321 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. started... 2023-09-27 07:02:50,321 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a66dd71169a0b09d53d1565a213196e6: 2023-09-27 07:02:50,322 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f710333f7796a83d329876971c1bde50: 2023-09-27 07:02:50,323 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,323 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,323 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:50,323 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:50,323 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:02:50,323 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-09-27 07:02:50,324 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 07:02:50,324 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:50,324 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 07:02:50,336 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. completed. 2023-09-27 07:02:50,336 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. completed. 2023-09-27 07:02:50,337 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:50,336 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 07:02:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:02:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 07:02:50,337 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:02:50,339 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,339 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 07:02:50,339 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 07:02:50,339 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:50,339 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:50,339 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 07:02:50,339 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:50,339 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 07:02:50,342 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,343 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:02:50,345 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-27 07:02:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:50,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40331,1695798070393': 2023-09-27 07:02:50,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-27 07:02:50,348 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-27 07:02:50,348 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:02:50,348 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:02:50,348 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,348 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:02:50,350 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,350 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:50,350 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:50,350 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,350 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,351 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:50,351 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:50,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,351 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:50,351 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:50,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,352 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:50,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,352 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:50,353 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,354 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,354 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,359 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,359 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,359 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,359 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,359 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:50,359 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:50,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:50,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:50,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,359 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:50,359 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,359 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,360 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,360 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:02:50,359 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:50,359 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:50,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:50,359 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:50,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:50,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:50,360 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:50,360 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:50,362 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,362 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:50,362 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-09-27 07:02:50,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:50,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:50,362 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:50,362 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,371 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,372 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,384 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:50,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 07:02:50,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:02:50,386 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:02:50,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,387 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-27 07:02:50,387 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,388 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,388 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695798170282Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695798170371 (+89 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695798170371Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695798170371Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695798170374 (+3 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1695798170381 (+7 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695798170387 (+6 ms) 2023-09-27 07:02:50,391 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 07:02:50,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 108 msec 2023-09-27 07:02:50,586 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:50,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 07:02:50,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:02:50,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43767] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:02:50,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40331] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. with WAL disabled. Data may be lost in the event of a crash. 2023-09-27 07:02:50,593 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,593 DEBUG [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:50,593 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-09-27 07:02:50,602 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 07:02:50,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1695798170602 (current time:1695798170602). 2023-09-27 07:02:50,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-09-27 07:02:50,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x2d4bd308 to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:50,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5fee3d4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:50,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:50,611 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37370, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:50,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2d4bd308 to 127.0.0.1:53388 2023-09-27 07:02:50,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:50,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(139): Connect 0x3db9099b to 127.0.0.1:53388 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-09-27 07:02:50,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4e195eb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-09-27 07:02:50,620 DEBUG [hconnection-0x60b30e77-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:50,622 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37380, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:50,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-09-27 07:02:50,632 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40408, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-09-27 07:02:50,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3db9099b to 127.0.0.1:53388 2023-09-27 07:02:50,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:02:50,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-09-27 07:02:50,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-09-27 07:02:50,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 07:02:50,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 07:02:50,637 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 07:02:50,638 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1695798770638 2023-09-27 07:02:50,638 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-09-27 07:02:50,639 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-09-27 07:02:50,639 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-09-27 07:02:50,640 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1028): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 07:02:50,640 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-09-27 07:02:50,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 4 msec 2023-09-27 07:02:50,642 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 07:02:50,643 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1695798770643 2023-09-27 07:02:50,655 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,655 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-09-27 07:02:50,655 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:50,657 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-09-27 07:02:50,657 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-09-27 07:02:50,657 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,657 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,658 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:50,658 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:50,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:50,658 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:50,658 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,659 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:50,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:50,659 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,659 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,659 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,659 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-09-27 07:02:50,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,659 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-09-27 07:02:50,660 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 07:02:50,660 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:50,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,662 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,662 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 07:02:50,662 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-09-27 07:02:50,662 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:50,662 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 07:02:50,662 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 07:02:50,663 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 07:02:50,662 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-09-27 07:02:50,663 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 07:02:50,663 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 07:02:50,663 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,33339,1695798070304' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 07:02:50,663 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-09-27 07:02:50,663 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-09-27 07:02:50,663 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-09-27 07:02:50,665 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,665 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:50,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:50,665 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,666 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,666 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,666 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,666 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:50,666 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,666 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:50,666 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,666 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-09-27 07:02:50,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:50,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:50,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43767,1695798070355' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 07:02:50,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@463052b8[Count = 1] remaining members to acquire global barrier 2023-09-27 07:02:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:50,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:50,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:50,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:50,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40331,1695798070393' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-09-27 07:02:50,670 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@463052b8[Count = 0] remaining members to acquire global barrier 2023-09-27 07:02:50,670 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-09-27 07:02:50,670 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,675 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,675 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,675 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,675 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 07:02:50,675 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,675 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 07:02:50,676 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-09-27 07:02:50,675 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 07:02:50,676 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:50,676 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:50,676 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:50,676 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-09-27 07:02:50,676 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-09-27 07:02:50,676 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,33339,1695798070304' in zk 2023-09-27 07:02:50,676 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:50,676 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. started... 2023-09-27 07:02:50,676 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:50,676 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:50,676 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-09-27 07:02:50,676 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. started... 2023-09-27 07:02:50,676 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f710333f7796a83d329876971c1bde50 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-09-27 07:02:50,676 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2745): Flushing a66dd71169a0b09d53d1565a213196e6 1/1 column families, dataSize=132 B heapSize=544 B 2023-09-27 07:02:50,678 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 07:02:50,678 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:50,678 DEBUG [member: 'jenkins-hbase4.apache.org,33339,1695798070304' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 07:02:50,702 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230927724db1f8f7124fc0877c939b4961629c to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927724db1f8f7124fc0877c939b4961629c 2023-09-27 07:02:50,703 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202309274ba851a3ce5d4d3aa44c9a748255ea28 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309274ba851a3ce5d4d3aa44c9a748255ea28 2023-09-27 07:02:50,710 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/.tmp/cf/50423ad789a4437d96f6c4f0e64a6a2b 2023-09-27 07:02:50,710 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/.tmp/cf/bf746ff60bf2451ea394155e7ee1fddd 2023-09-27 07:02:50,716 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/.tmp/cf/50423ad789a4437d96f6c4f0e64a6a2b as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/cf/50423ad789a4437d96f6c4f0e64a6a2b 2023-09-27 07:02:50,716 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/.tmp/cf/bf746ff60bf2451ea394155e7ee1fddd as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/cf/bf746ff60bf2451ea394155e7ee1fddd 2023-09-27 07:02:50,720 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/cf/bf746ff60bf2451ea394155e7ee1fddd, entries=2, sequenceid=6, filesize=5.2 K 2023-09-27 07:02:50,720 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/cf/50423ad789a4437d96f6c4f0e64a6a2b, entries=48, sequenceid=6, filesize=13.5 K 2023-09-27 07:02:50,721 INFO [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for a66dd71169a0b09d53d1565a213196e6 in 45ms, sequenceid=6, compaction requested=false 2023-09-27 07:02:50,721 INFO [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for f710333f7796a83d329876971c1bde50 in 45ms, sequenceid=6, compaction requested=false 2023-09-27 07:02:50,721 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-27 07:02:50,721 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-09-27 07:02:50,724 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for a66dd71169a0b09d53d1565a213196e6: 2023-09-27 07:02:50,724 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f710333f7796a83d329876971c1bde50: 2023-09-27 07:02:50,724 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,724 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,724 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:50,724 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-09-27 07:02:50,724 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/cf/bf746ff60bf2451ea394155e7ee1fddd] hfiles 2023-09-27 07:02:50,724 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/cf/50423ad789a4437d96f6c4f0e64a6a2b] hfiles 2023-09-27 07:02:50,724 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/cf/bf746ff60bf2451ea394155e7ee1fddd for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,724 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/cf/50423ad789a4437d96f6c4f0e64a6a2b for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:50,740 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:50,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 07:02:50,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:02:50,741 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-09-27 07:02:50,942 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:50,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 07:02:50,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-09-27 07:02:50,943 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-09-27 07:02:51,131 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. completed. 2023-09-27 07:02:51,131 DEBUG [rs(jenkins-hbase4.apache.org,40331,1695798070393)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:02:51,131 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. completed. 2023-09-27 07:02:51,131 DEBUG [rs(jenkins-hbase4.apache.org,43767,1695798070355)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:02:51,131 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:51,132 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:51,132 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-09-27 07:02:51,132 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-09-27 07:02:51,132 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,132 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,132 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 07:02:51,132 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-09-27 07:02:51,132 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43767,1695798070355' in zk 2023-09-27 07:02:51,132 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,40331,1695798070393' in zk 2023-09-27 07:02:51,134 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 07:02:51,134 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:51,134 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,134 DEBUG [member: 'jenkins-hbase4.apache.org,43767,1695798070355' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 07:02:51,136 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,134 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-09-27 07:02:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:51,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:51,136 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:51,136 DEBUG [member: 'jenkins-hbase4.apache.org,40331,1695798070393' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-09-27 07:02:51,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:51,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:51,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:51,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:51,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43767,1695798070355': 2023-09-27 07:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43767,1695798070355' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-09-27 07:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:51,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,142 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:51,143 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,40331,1695798070393': 2023-09-27 07:02:51,143 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40331,1695798070393' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-09-27 07:02:51,143 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-09-27 07:02:51,143 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-09-27 07:02:51,143 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-09-27 07:02:51,143 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,143 INFO [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-09-27 07:02:51,144 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:51,145 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:51,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-09-27 07:02:51,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-09-27 07:02:51,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:51,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-09-27 07:02:51,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:51,145 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:51,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:51,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:51,146 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,146 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,146 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-09-27 07:02:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:51,147 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-09-27 07:02:51,148 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,148 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:51,154 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:51,154 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,154 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:51,154 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:51,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:51,154 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:51,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:51,154 DEBUG [(jenkins-hbase4.apache.org,41725,1695798069016)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-09-27 07:02:51,154 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-09-27 07:02:51,154 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,154 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-09-27 07:02:51,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:51,154 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:51,154 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:51,154 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-09-27 07:02:51,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-09-27 07:02:51,156 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,156 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:51,156 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:51,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:51,156 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:02:51,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:51,156 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-09-27 07:02:51,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-09-27 07:02:51,156 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:02:51,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-09-27 07:02:51,156 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:02:51,156 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,156 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927724db1f8f7124fc0877c939b4961629c, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309274ba851a3ce5d4d3aa44c9a748255ea28] mob files 2023-09-27 07:02:51,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927724db1f8f7124fc0877c939b4961629c 2023-09-27 07:02:51,157 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309274ba851a3ce5d4d3aa44c9a748255ea28 2023-09-27 07:02:51,163 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,164 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,179 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-09-27 07:02:51,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,180 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1695798170638Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1695798171163 (+525 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695798171163Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1695798171164 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1695798171167 (+3 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1695798171173 (+6 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1695798171180 (+7 ms) 2023-09-27 07:02:51,183 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-09-27 07:02:51,184 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 544 msec 2023-09-27 07:02:51,243 DEBUG [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-09-27 07:02:51,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-09-27 07:02:51,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-09-27 07:02:51,244 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798171244 2023-09-27 07:02:51,245 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35855, tgtDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798171244, rawTgtDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798171244, srcFsUri=hdfs://localhost:35855, srcDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:02:51,266 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18 2023-09-27 07:02:51,267 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1583868725_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798171244, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798171244/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,267 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35855, inputRoot=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18, snapshotDir=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-09-27 07:02:51,276 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798171244/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:02:51,300 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:51,301 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:51,301 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:51,301 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:52,175 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-8221239098710284725.jar 2023-09-27 07:02:52,175 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:52,176 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:52,242 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/hadoop-9090982177407020190.jar 2023-09-27 07:02:52,242 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:52,243 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:52,243 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:52,243 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:52,244 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:52,244 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-09-27 07:02:52,244 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-09-27 07:02:52,245 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-09-27 07:02:52,245 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-09-27 07:02:52,245 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-09-27 07:02:52,246 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-09-27 07:02:52,246 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-09-27 07:02:52,247 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-09-27 07:02:52,247 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-09-27 07:02:52,247 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-09-27 07:02:52,248 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-09-27 07:02:52,248 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:52,249 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:52,249 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:52,249 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:52,250 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-09-27 07:02:52,250 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:52,250 DEBUG [Listener at jenkins-hbase4.apache.org/36133] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-09-27 07:02:52,584 WARN [Listener at jenkins-hbase4.apache.org/36133] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-09-27 07:02:52,586 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-09-27 07:02:52,588 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-09-27 07:02:53,715 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:02:53,715 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-09-27 07:02:53,717 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0006_000001 (auth:SIMPLE) 2023-09-27 07:02:54,623 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0007_000001 (auth:SIMPLE) 2023-09-27 07:02:54,889 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 07:02:58,422 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0007_000001 (auth:SIMPLE) 2023-09-27 07:03:00,630 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0007_000001 (auth:SIMPLE) 2023-09-27 07:03:03,226 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1695798076919_0007_000001 (auth:SIMPLE) 2023-09-27 07:03:04,750 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-09-27 07:03:04,750 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-09-27 07:03:04,760 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:04,761 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(279): Exported snapshot 2023-09-27 07:03:04,761 INFO [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-09-27 07:03:04,761 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:04,762 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-27 07:03:04,762 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-27 07:03:04,762 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-409070372_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798171244/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798171244/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:04,762 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798171244/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-09-27 07:03:04,762 DEBUG [Listener at jenkins-hbase4.apache.org/36133] snapshot.TestExportSnapshot(367): hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/export-test/export-1695798171244/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-09-27 07:03:04,767 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:04,767 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:04,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:04,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 07:03:04,771 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798184771"}]},"ts":"1695798184771"} 2023-09-27 07:03:04,773 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-09-27 07:03:04,774 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-09-27 07:03:04,774 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a66dd71169a0b09d53d1565a213196e6, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f710333f7796a83d329876971c1bde50, UNASSIGN}] 2023-09-27 07:03:04,776 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a66dd71169a0b09d53d1565a213196e6, UNASSIGN 2023-09-27 07:03:04,776 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f710333f7796a83d329876971c1bde50, UNASSIGN 2023-09-27 07:03:04,777 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a66dd71169a0b09d53d1565a213196e6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:03:04,777 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=f710333f7796a83d329876971c1bde50, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:03:04,777 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695798184777"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798184777"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798184777"}]},"ts":"1695798184777"} 2023-09-27 07:03:04,777 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695798184777"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1695798184777"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1695798184777"}]},"ts":"1695798184777"} 2023-09-27 07:03:04,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure a66dd71169a0b09d53d1565a213196e6, server=jenkins-hbase4.apache.org,43767,1695798070355}] 2023-09-27 07:03:04,779 INFO [PEWorker-4] procedure2.ProcedureExecutor(1680): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure f710333f7796a83d329876971c1bde50, server=jenkins-hbase4.apache.org,40331,1695798070393}] 2023-09-27 07:03:04,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 07:03:04,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:03:04,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a66dd71169a0b09d53d1565a213196e6, disabling compactions & flushes 2023-09-27 07:03:04,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:03:04,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:03:04,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. after waiting 0 ms 2023-09-27 07:03:04,930 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:03:04,934 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f710333f7796a83d329876971c1bde50 2023-09-27 07:03:04,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f710333f7796a83d329876971c1bde50, disabling compactions & flushes 2023-09-27 07:03:04,935 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:03:04,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:03:04,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. after waiting 0 ms 2023-09-27 07:03:04,935 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:03:04,943 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:03:04,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:03:04,944 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:03:04,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6. 2023-09-27 07:03:04,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a66dd71169a0b09d53d1565a213196e6: 2023-09-27 07:03:04,945 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:03:04,946 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50. 2023-09-27 07:03:04,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f710333f7796a83d329876971c1bde50: 2023-09-27 07:03:04,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:03:04,947 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=a66dd71169a0b09d53d1565a213196e6, regionState=CLOSED 2023-09-27 07:03:04,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f710333f7796a83d329876971c1bde50 2023-09-27 07:03:04,947 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695798184947"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798184947"}]},"ts":"1695798184947"} 2023-09-27 07:03:04,948 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=f710333f7796a83d329876971c1bde50, regionState=CLOSED 2023-09-27 07:03:04,948 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1695798184948"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1695798184948"}]},"ts":"1695798184948"} 2023-09-27 07:03:04,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=117, resume processing ppid=115 2023-09-27 07:03:04,952 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure a66dd71169a0b09d53d1565a213196e6, server=jenkins-hbase4.apache.org,43767,1695798070355 in 171 msec 2023-09-27 07:03:04,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=118, resume processing ppid=116 2023-09-27 07:03:04,953 INFO [PEWorker-5] procedure2.ProcedureExecutor(1409): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure f710333f7796a83d329876971c1bde50, server=jenkins-hbase4.apache.org,40331,1695798070393 in 170 msec 2023-09-27 07:03:04,953 INFO [PEWorker-4] procedure2.ProcedureExecutor(1409): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=a66dd71169a0b09d53d1565a213196e6, UNASSIGN in 178 msec 2023-09-27 07:03:04,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1823): Finished subprocedure pid=116, resume processing ppid=114 2023-09-27 07:03:04,954 INFO [PEWorker-1] procedure2.ProcedureExecutor(1409): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=f710333f7796a83d329876971c1bde50, UNASSIGN in 179 msec 2023-09-27 07:03:04,955 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1695798184955"}]},"ts":"1695798184955"} 2023-09-27 07:03:04,956 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-09-27 07:03:04,957 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-09-27 07:03:04,959 INFO [PEWorker-3] procedure2.ProcedureExecutor(1409): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 190 msec 2023-09-27 07:03:05,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-09-27 07:03:05,074 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-09-27 07:03:05,074 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] procedure2.ProcedureExecutor(1028): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,077 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,078 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,079 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40331] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,082 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:03:05,082 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50 2023-09-27 07:03:05,083 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,083 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,083 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,083 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,083 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 07:03:05,083 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 07:03:05,083 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 07:03:05,083 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-09-27 07:03:05,084 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,084 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/recovered.edits] 2023-09-27 07:03:05,084 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,084 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:03:05,084 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:03:05,084 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,085 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:03:05,085 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/cf, FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/recovered.edits] 2023-09-27 07:03:05,085 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,085 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-09-27 07:03:05,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-27 07:03:05,088 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/cf/bf746ff60bf2451ea394155e7ee1fddd to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/cf/bf746ff60bf2451ea394155e7ee1fddd 2023-09-27 07:03:05,088 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/cf/50423ad789a4437d96f6c4f0e64a6a2b to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/cf/50423ad789a4437d96f6c4f0e64a6a2b 2023-09-27 07:03:05,091 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6/recovered.edits/9.seqid 2023-09-27 07:03:05,091 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/recovered.edits/9.seqid to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50/recovered.edits/9.seqid 2023-09-27 07:03:05,092 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/a66dd71169a0b09d53d1565a213196e6 2023-09-27 07:03:05,092 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/f710333f7796a83d329876971c1bde50 2023-09-27 07:03:05,092 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-09-27 07:03:05,092 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-27 07:03:05,093 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-09-27 07:03:05,095 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927724db1f8f7124fc0877c939b4961629c to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230927724db1f8f7124fc0877c939b4961629c 2023-09-27 07:03:05,096 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309274ba851a3ce5d4d3aa44c9a748255ea28 to hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202309274ba851a3ce5d4d3aa44c9a748255ea28 2023-09-27 07:03:05,097 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-09-27 07:03:05,099 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,101 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-09-27 07:03:05,103 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-09-27 07:03:05,104 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,104 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-09-27 07:03:05,104 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798185104"}]},"ts":"9223372036854775807"} 2023-09-27 07:03:05,104 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1695798185104"}]},"ts":"9223372036854775807"} 2023-09-27 07:03:05,106 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-09-27 07:03:05,106 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a66dd71169a0b09d53d1565a213196e6, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1695798169626.a66dd71169a0b09d53d1565a213196e6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f710333f7796a83d329876971c1bde50, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1695798169626.f710333f7796a83d329876971c1bde50.', STARTKEY => '1', ENDKEY => ''}] 2023-09-27 07:03:05,106 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-09-27 07:03:05,106 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1695798185106"}]},"ts":"9223372036854775807"} 2023-09-27 07:03:05,109 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-09-27 07:03:05,111 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,112 INFO [PEWorker-2] procedure2.ProcedureExecutor(1409): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 37 msec 2023-09-27 07:03:05,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-09-27 07:03:05,187 INFO [Listener at jenkins-hbase4.apache.org/36133] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-09-27 07:03:05,193 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-27 07:03:05,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-09-27 07:03:05,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41725] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-09-27 07:03:05,222 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=765 (was 764) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:48182 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:37759 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1651033673_1 at /127.0.0.1:60014 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x12aa2eb7-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1013087597_17 at /127.0.0.1:57590 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1651033673_1 at /127.0.0.1:48146 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-409070372_17 at /127.0.0.1:60022 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5221 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) - Thread LEAK? -, OpenFileDescriptor=908 (was 927), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=199 (was 177) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3327 (was 3410) 2023-09-27 07:03:05,223 WARN [Listener at jenkins-hbase4.apache.org/36133] hbase.ResourceChecker(130): Thread=765 is superior to 500 2023-09-27 07:03:05,223 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-09-27 07:03:05,233 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-27 07:03:05,344 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1695798076919_0007_01_000001 is : 143 2023-09-27 07:03:10,529 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-09-27 07:03:19,357 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-27 07:03:33,474 ERROR [Thread[Thread-410,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 07:03:33,475 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-27 07:03:33,583 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-09-27 07:03:33,591 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-09-27 07:03:33,592 ERROR [Thread[Thread-420,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 07:03:33,603 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-09-27 07:03:33,707 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-09-27 07:03:33,707 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-09-27 07:03:33,707 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-09-27 07:03:33,707 INFO [Listener at jenkins-hbase4.apache.org/36133] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-09-27 07:03:33,707 DEBUG [Listener at jenkins-hbase4.apache.org/36133] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0cba4ac7 to 127.0.0.1:53388 2023-09-27 07:03:33,707 DEBUG [Listener at jenkins-hbase4.apache.org/36133] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:03:33,707 DEBUG [Listener at jenkins-hbase4.apache.org/36133] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-09-27 07:03:33,708 DEBUG [Listener at jenkins-hbase4.apache.org/36133] util.JVMClusterUtil(257): Found active master hash=1262805192, stopped=false 2023-09-27 07:03:33,708 DEBUG [Listener at jenkins-hbase4.apache.org/36133] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:03:33,708 DEBUG [Listener at jenkins-hbase4.apache.org/36133] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-09-27 07:03:33,708 INFO [Listener at jenkins-hbase4.apache.org/36133] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41725,1695798069016 2023-09-27 07:03:33,709 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 07:03:33,709 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 07:03:33,709 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:03:33,709 INFO [Listener at jenkins-hbase4.apache.org/36133] procedure2.ProcedureExecutor(628): Stopping 2023-09-27 07:03:33,709 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 07:03:33,709 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-09-27 07:03:33,710 DEBUG [Listener at jenkins-hbase4.apache.org/36133] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c5c1e5b to 127.0.0.1:53388 2023-09-27 07:03:33,710 DEBUG [Listener at jenkins-hbase4.apache.org/36133] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:03:33,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 07:03:33,710 INFO [Listener at jenkins-hbase4.apache.org/36133] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,33339,1695798070304' ***** 2023-09-27 07:03:33,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 07:03:33,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 07:03:33,710 DEBUG [Listener at jenkins-hbase4.apache.org/36133] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:03:33,710 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-09-27 07:03:33,710 INFO [Listener at jenkins-hbase4.apache.org/36133] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 07:03:33,710 INFO [Listener at jenkins-hbase4.apache.org/36133] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43767,1695798070355' ***** 2023-09-27 07:03:33,711 DEBUG [Listener at jenkins-hbase4.apache.org/36133] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:03:33,711 INFO [RS:0;jenkins-hbase4:33339] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 07:03:33,711 INFO [Listener at jenkins-hbase4.apache.org/36133] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 07:03:33,711 INFO [Listener at jenkins-hbase4.apache.org/36133] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40331,1695798070393' ***** 2023-09-27 07:03:33,711 INFO [RS:0;jenkins-hbase4:33339] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 07:03:33,711 DEBUG [Listener at jenkins-hbase4.apache.org/36133] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:03:33,711 INFO [RS:0;jenkins-hbase4:33339] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 07:03:33,711 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 07:03:33,711 INFO [RS:1;jenkins-hbase4:43767] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 07:03:33,711 INFO [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:03:33,711 INFO [RS:1;jenkins-hbase4:43767] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 07:03:33,711 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 07:03:33,711 INFO [Listener at jenkins-hbase4.apache.org/36133] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-09-27 07:03:33,711 INFO [RS:1;jenkins-hbase4:43767] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 07:03:33,711 DEBUG [RS:0;jenkins-hbase4:33339] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6a2b73db to 127.0.0.1:53388 2023-09-27 07:03:33,711 INFO [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:03:33,711 INFO [RS:2;jenkins-hbase4:40331] regionserver.HeapMemoryManager(220): Stopping 2023-09-27 07:03:33,711 DEBUG [RS:1;jenkins-hbase4:43767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x76851eb1 to 127.0.0.1:53388 2023-09-27 07:03:33,712 INFO [RS:2;jenkins-hbase4:40331] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-09-27 07:03:33,711 DEBUG [RS:0;jenkins-hbase4:33339] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:03:33,712 INFO [RS:2;jenkins-hbase4:40331] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-09-27 07:03:33,712 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-09-27 07:03:33,714 INFO [RS:0;jenkins-hbase4:33339] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 07:03:33,712 DEBUG [RS:1;jenkins-hbase4:43767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:03:33,714 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(3305): Received CLOSE for acfad5a895ba2ce613fab0e33e42ee5b 2023-09-27 07:03:33,714 INFO [RS:0;jenkins-hbase4:33339] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 07:03:33,715 INFO [RS:0;jenkins-hbase4:33339] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 07:03:33,715 INFO [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43767,1695798070355; all regions closed. 2023-09-27 07:03:33,715 INFO [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-09-27 07:03:33,715 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(3305): Received CLOSE for adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:03:33,715 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:03:33,715 DEBUG [RS:2;jenkins-hbase4:40331] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5728a773 to 127.0.0.1:53388 2023-09-27 07:03:33,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing acfad5a895ba2ce613fab0e33e42ee5b, disabling compactions & flushes 2023-09-27 07:03:33,716 DEBUG [RS:2;jenkins-hbase4:40331] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:03:33,715 INFO [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-09-27 07:03:33,716 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1474): Waiting on 2 regions to close 2023-09-27 07:03:33,717 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-09-27 07:03:33,717 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1478): Online Regions={acfad5a895ba2ce613fab0e33e42ee5b=hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b., adea58e84d4895d882491dd24dce5c4e=hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e.} 2023-09-27 07:03:33,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-09-27 07:03:33,717 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-09-27 07:03:33,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:03:33,717 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-09-27 07:03:33,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:03:33,717 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-09-27 07:03:33,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. after waiting 0 ms 2023-09-27 07:03:33,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:03:33,717 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-09-27 07:03:33,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing acfad5a895ba2ce613fab0e33e42ee5b 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-09-27 07:03:33,717 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-09-27 07:03:33,718 DEBUG [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1504): Waiting on acfad5a895ba2ce613fab0e33e42ee5b, adea58e84d4895d882491dd24dce5c4e 2023-09-27 07:03:33,718 DEBUG [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-09-27 07:03:33,734 DEBUG [RS:1;jenkins-hbase4:43767] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/oldWALs 2023-09-27 07:03:33,734 INFO [RS:1;jenkins-hbase4:43767] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43767%2C1695798070355:(num 1695798072101) 2023-09-27 07:03:33,734 DEBUG [RS:1;jenkins-hbase4:43767] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:03:33,734 INFO [RS:1;jenkins-hbase4:43767] regionserver.LeaseManager(133): Closed leases 2023-09-27 07:03:33,741 INFO [RS:1;jenkins-hbase4:43767] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-09-27 07:03:33,741 INFO [RS:1;jenkins-hbase4:43767] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 07:03:33,741 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 07:03:33,741 INFO [RS:1;jenkins-hbase4:43767] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 07:03:33,741 INFO [RS:1;jenkins-hbase4:43767] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 07:03:33,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b/.tmp/l/bc1056ce8a1f46c0a362be3a5d86aa53 2023-09-27 07:03:33,750 INFO [RS:1;jenkins-hbase4:43767] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43767 2023-09-27 07:03:33,757 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/.tmp/info/beb86ddafcfd4c7d90d5be279d59231a 2023-09-27 07:03:33,758 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:03:33,758 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:03:33,758 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 07:03:33,758 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 07:03:33,758 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43767,1695798070355 2023-09-27 07:03:33,759 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 07:03:33,759 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 07:03:33,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc1056ce8a1f46c0a362be3a5d86aa53 2023-09-27 07:03:33,761 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43767,1695798070355] 2023-09-27 07:03:33,762 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43767,1695798070355; numProcessing=1 2023-09-27 07:03:33,762 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b/.tmp/l/bc1056ce8a1f46c0a362be3a5d86aa53 as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b/l/bc1056ce8a1f46c0a362be3a5d86aa53 2023-09-27 07:03:33,763 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 07:03:33,763 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 07:03:33,763 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43767,1695798070355 already deleted, retry=false 2023-09-27 07:03:33,763 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for beb86ddafcfd4c7d90d5be279d59231a 2023-09-27 07:03:33,763 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-09-27 07:03:33,763 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43767,1695798070355 expired; onlineServers=2 2023-09-27 07:03:33,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for bc1056ce8a1f46c0a362be3a5d86aa53 2023-09-27 07:03:33,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b/l/bc1056ce8a1f46c0a362be3a5d86aa53, entries=7, sequenceid=18, filesize=5.2 K 2023-09-27 07:03:33,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for acfad5a895ba2ce613fab0e33e42ee5b in 51ms, sequenceid=18, compaction requested=false 2023-09-27 07:03:33,779 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/acl/acfad5a895ba2ce613fab0e33e42ee5b/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-09-27 07:03:33,780 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:03:33,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:03:33,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for acfad5a895ba2ce613fab0e33e42ee5b: 2023-09-27 07:03:33,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1695798073290.acfad5a895ba2ce613fab0e33e42ee5b. 2023-09-27 07:03:33,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing adea58e84d4895d882491dd24dce5c4e, disabling compactions & flushes 2023-09-27 07:03:33,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:03:33,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:03:33,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. after waiting 0 ms 2023-09-27 07:03:33,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:03:33,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing adea58e84d4895d882491dd24dce5c4e 1/1 column families, dataSize=78 B heapSize=488 B 2023-09-27 07:03:33,782 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/.tmp/rep_barrier/e5a12a76edd649569e1d993368c8eda7 2023-09-27 07:03:33,787 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5a12a76edd649569e1d993368c8eda7 2023-09-27 07:03:33,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e/.tmp/info/2966bd980ef640b282d9e7e1a8284b07 2023-09-27 07:03:33,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e/.tmp/info/2966bd980ef640b282d9e7e1a8284b07 as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e/info/2966bd980ef640b282d9e7e1a8284b07 2023-09-27 07:03:33,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e/info/2966bd980ef640b282d9e7e1a8284b07, entries=2, sequenceid=6, filesize=4.8 K 2023-09-27 07:03:33,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for adea58e84d4895d882491dd24dce5c4e in 24ms, sequenceid=6, compaction requested=false 2023-09-27 07:03:33,822 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/.tmp/table/f20f43305a054a80bf403d31082b4b91 2023-09-27 07:03:33,823 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/namespace/adea58e84d4895d882491dd24dce5c4e/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-09-27 07:03:33,824 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:03:33,825 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:03:33,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for adea58e84d4895d882491dd24dce5c4e: 2023-09-27 07:03:33,825 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1695798072542.adea58e84d4895d882491dd24dce5c4e. 2023-09-27 07:03:33,827 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f20f43305a054a80bf403d31082b4b91 2023-09-27 07:03:33,828 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/.tmp/info/beb86ddafcfd4c7d90d5be279d59231a as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/info/beb86ddafcfd4c7d90d5be279d59231a 2023-09-27 07:03:33,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for beb86ddafcfd4c7d90d5be279d59231a 2023-09-27 07:03:33,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/info/beb86ddafcfd4c7d90d5be279d59231a, entries=48, sequenceid=131, filesize=10.3 K 2023-09-27 07:03:33,834 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/.tmp/rep_barrier/e5a12a76edd649569e1d993368c8eda7 as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/rep_barrier/e5a12a76edd649569e1d993368c8eda7 2023-09-27 07:03:33,838 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5a12a76edd649569e1d993368c8eda7 2023-09-27 07:03:33,839 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/rep_barrier/e5a12a76edd649569e1d993368c8eda7, entries=13, sequenceid=131, filesize=6.4 K 2023-09-27 07:03:33,839 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/.tmp/table/f20f43305a054a80bf403d31082b4b91 as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/table/f20f43305a054a80bf403d31082b4b91 2023-09-27 07:03:33,844 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f20f43305a054a80bf403d31082b4b91 2023-09-27 07:03:33,844 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/table/f20f43305a054a80bf403d31082b4b91, entries=24, sequenceid=131, filesize=6.9 K 2023-09-27 07:03:33,845 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 128ms, sequenceid=131, compaction requested=false 2023-09-27 07:03:33,858 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-09-27 07:03:33,859 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-09-27 07:03:33,859 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-09-27 07:03:33,860 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-09-27 07:03:33,860 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-09-27 07:03:33,860 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-09-27 07:03:33,862 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 07:03:33,862 INFO [RS:1;jenkins-hbase4:43767] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43767,1695798070355; zookeeper connection closed. 2023-09-27 07:03:33,862 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:43767-0x100ec303b0a0002, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 07:03:33,862 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7957cf90] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7957cf90 2023-09-27 07:03:33,918 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40331,1695798070393; all regions closed. 2023-09-27 07:03:33,918 INFO [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,33339,1695798070304; all regions closed. 2023-09-27 07:03:33,925 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-09-27 07:03:33,925 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-09-27 07:03:33,926 DEBUG [RS:2;jenkins-hbase4:40331] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/oldWALs 2023-09-27 07:03:33,926 INFO [RS:2;jenkins-hbase4:40331] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40331%2C1695798070393:(num 1695798072101) 2023-09-27 07:03:33,926 DEBUG [RS:0;jenkins-hbase4:33339] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/oldWALs 2023-09-27 07:03:33,926 INFO [RS:0;jenkins-hbase4:33339] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33339%2C1695798070304.meta:.meta(num 1695798072235) 2023-09-27 07:03:33,926 DEBUG [RS:2;jenkins-hbase4:40331] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:03:33,926 INFO [RS:2;jenkins-hbase4:40331] regionserver.LeaseManager(133): Closed leases 2023-09-27 07:03:33,926 INFO [RS:2;jenkins-hbase4:40331] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-27 07:03:33,927 INFO [RS:2;jenkins-hbase4:40331] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-09-27 07:03:33,927 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 07:03:33,927 INFO [RS:2;jenkins-hbase4:40331] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-09-27 07:03:33,927 INFO [RS:2;jenkins-hbase4:40331] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-09-27 07:03:33,928 INFO [RS:2;jenkins-hbase4:40331] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40331 2023-09-27 07:03:33,930 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:03:33,930 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40331,1695798070393 2023-09-27 07:03:33,930 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 07:03:33,931 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40331,1695798070393] 2023-09-27 07:03:33,931 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40331,1695798070393; numProcessing=2 2023-09-27 07:03:33,933 DEBUG [RS:0;jenkins-hbase4:33339] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/oldWALs 2023-09-27 07:03:33,933 INFO [RS:0;jenkins-hbase4:33339] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33339%2C1695798070304:(num 1695798072101) 2023-09-27 07:03:33,933 DEBUG [RS:0;jenkins-hbase4:33339] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:03:33,933 INFO [RS:0;jenkins-hbase4:33339] regionserver.LeaseManager(133): Closed leases 2023-09-27 07:03:33,933 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40331,1695798070393 already deleted, retry=false 2023-09-27 07:03:33,933 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,40331,1695798070393 expired; onlineServers=1 2023-09-27 07:03:33,933 INFO [RS:0;jenkins-hbase4:33339] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-09-27 07:03:33,933 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 07:03:33,934 INFO [RS:0;jenkins-hbase4:33339] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33339 2023-09-27 07:03:33,935 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33339,1695798070304 2023-09-27 07:03:33,935 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-09-27 07:03:33,937 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33339,1695798070304] 2023-09-27 07:03:33,937 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33339,1695798070304; numProcessing=3 2023-09-27 07:03:33,938 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33339,1695798070304 already deleted, retry=false 2023-09-27 07:03:33,938 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,33339,1695798070304 expired; onlineServers=0 2023-09-27 07:03:33,938 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,41725,1695798069016' ***** 2023-09-27 07:03:33,938 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-09-27 07:03:33,938 DEBUG [M:0;jenkins-hbase4:41725] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a79eaf3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-09-27 07:03:33,938 INFO [M:0;jenkins-hbase4:41725] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,41725,1695798069016 2023-09-27 07:03:33,938 INFO [M:0;jenkins-hbase4:41725] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,41725,1695798069016; all regions closed. 2023-09-27 07:03:33,938 DEBUG [M:0;jenkins-hbase4:41725] ipc.AbstractRpcClient(494): Stopping rpc client 2023-09-27 07:03:33,938 DEBUG [M:0;jenkins-hbase4:41725] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-09-27 07:03:33,938 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-09-27 07:03:33,939 DEBUG [M:0;jenkins-hbase4:41725] cleaner.HFileCleaner(317): Stopping file delete threads 2023-09-27 07:03:33,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695798071708] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1695798071708,5,FailOnTimeoutGroup] 2023-09-27 07:03:33,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695798071709] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1695798071709,5,FailOnTimeoutGroup] 2023-09-27 07:03:33,939 INFO [M:0;jenkins-hbase4:41725] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-09-27 07:03:33,939 INFO [M:0;jenkins-hbase4:41725] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-09-27 07:03:33,939 INFO [M:0;jenkins-hbase4:41725] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-09-27 07:03:33,939 DEBUG [M:0;jenkins-hbase4:41725] master.HMaster(1512): Stopping service threads 2023-09-27 07:03:33,939 INFO [M:0;jenkins-hbase4:41725] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-09-27 07:03:33,939 ERROR [M:0;jenkins-hbase4:41725] procedure2.ProcedureExecutor(652): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-14,5,PEWorkerGroup] Thread[HFileArchiver-15,5,PEWorkerGroup] 2023-09-27 07:03:33,940 INFO [M:0;jenkins-hbase4:41725] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-09-27 07:03:33,940 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-09-27 07:03:33,940 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-09-27 07:03:33,940 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-09-27 07:03:33,940 DEBUG [M:0;jenkins-hbase4:41725] zookeeper.ZKUtil(398): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-09-27 07:03:33,940 WARN [M:0;jenkins-hbase4:41725] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-09-27 07:03:33,940 INFO [M:0;jenkins-hbase4:41725] assignment.AssignmentManager(315): Stopping assignment manager 2023-09-27 07:03:33,941 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-09-27 07:03:33,941 INFO [M:0;jenkins-hbase4:41725] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-09-27 07:03:33,941 DEBUG [M:0;jenkins-hbase4:41725] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-09-27 07:03:33,941 INFO [M:0;jenkins-hbase4:41725] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 07:03:33,941 DEBUG [M:0;jenkins-hbase4:41725] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 07:03:33,941 DEBUG [M:0;jenkins-hbase4:41725] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-09-27 07:03:33,941 DEBUG [M:0;jenkins-hbase4:41725] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 07:03:33,942 INFO [M:0;jenkins-hbase4:41725] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.88 KB heapSize=452.19 KB 2023-09-27 07:03:33,959 INFO [M:0;jenkins-hbase4:41725] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.88 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cf9c271ed74246a0b3d1cf0f494be771 2023-09-27 07:03:33,963 INFO [M:0;jenkins-hbase4:41725] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf9c271ed74246a0b3d1cf0f494be771 2023-09-27 07:03:33,964 DEBUG [M:0;jenkins-hbase4:41725] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/cf9c271ed74246a0b3d1cf0f494be771 as hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cf9c271ed74246a0b3d1cf0f494be771 2023-09-27 07:03:33,968 INFO [M:0;jenkins-hbase4:41725] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for cf9c271ed74246a0b3d1cf0f494be771 2023-09-27 07:03:33,968 INFO [M:0;jenkins-hbase4:41725] regionserver.HStore(1080): Added hdfs://localhost:35855/user/jenkins/test-data/f4c21675-275a-2294-6abd-38e5bb5b0a18/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/cf9c271ed74246a0b3d1cf0f494be771, entries=119, sequenceid=899, filesize=28.7 K 2023-09-27 07:03:33,969 INFO [M:0;jenkins-hbase4:41725] regionserver.HRegion(2948): Finished flush of dataSize ~375.88 KB/384901, heapSize ~452.17 KB/463024, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-09-27 07:03:33,970 INFO [M:0;jenkins-hbase4:41725] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-09-27 07:03:33,970 DEBUG [M:0;jenkins-hbase4:41725] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-09-27 07:03:33,974 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-09-27 07:03:33,974 INFO [M:0;jenkins-hbase4:41725] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-09-27 07:03:33,975 INFO [M:0;jenkins-hbase4:41725] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41725 2023-09-27 07:03:33,976 DEBUG [M:0;jenkins-hbase4:41725] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41725,1695798069016 already deleted, retry=false 2023-09-27 07:03:34,032 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 07:03:34,032 INFO [RS:2;jenkins-hbase4:40331] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40331,1695798070393; zookeeper connection closed. 2023-09-27 07:03:34,032 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:40331-0x100ec303b0a0003, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 07:03:34,032 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3b0f241d] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3b0f241d 2023-09-27 07:03:34,132 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 07:03:34,132 INFO [M:0;jenkins-hbase4:41725] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,41725,1695798069016; zookeeper connection closed. 2023-09-27 07:03:34,132 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): master:41725-0x100ec303b0a0000, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 07:03:34,232 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 07:03:34,232 INFO [RS:0;jenkins-hbase4:33339] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,33339,1695798070304; zookeeper connection closed. 2023-09-27 07:03:34,232 DEBUG [Listener at localhost/43391-EventThread] zookeeper.ZKWatcher(600): regionserver:33339-0x100ec303b0a0001, quorum=127.0.0.1:53388, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-09-27 07:03:34,233 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@601ac19e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@601ac19e 2023-09-27 07:03:34,233 INFO [Listener at jenkins-hbase4.apache.org/36133] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-09-27 07:03:34,233 WARN [Listener at jenkins-hbase4.apache.org/36133] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 07:03:34,237 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 07:03:34,339 WARN [BP-317658032-172.31.14.131-1695798065216 heartbeating to localhost/127.0.0.1:35855] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 07:03:34,340 WARN [BP-317658032-172.31.14.131-1695798065216 heartbeating to localhost/127.0.0.1:35855] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-317658032-172.31.14.131-1695798065216 (Datanode Uuid 3dc7c712-0ac5-4edd-ae0d-3b332eba54bc) service to localhost/127.0.0.1:35855 2023-09-27 07:03:34,341 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data5/current/BP-317658032-172.31.14.131-1695798065216] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 07:03:34,342 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data6/current/BP-317658032-172.31.14.131-1695798065216] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 07:03:34,343 WARN [Listener at jenkins-hbase4.apache.org/36133] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 07:03:34,346 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 07:03:34,449 WARN [BP-317658032-172.31.14.131-1695798065216 heartbeating to localhost/127.0.0.1:35855] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 07:03:34,449 WARN [BP-317658032-172.31.14.131-1695798065216 heartbeating to localhost/127.0.0.1:35855] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-317658032-172.31.14.131-1695798065216 (Datanode Uuid 053366f6-ec2f-49a7-8e54-cba21a258d51) service to localhost/127.0.0.1:35855 2023-09-27 07:03:34,450 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data3/current/BP-317658032-172.31.14.131-1695798065216] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 07:03:34,450 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data4/current/BP-317658032-172.31.14.131-1695798065216] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 07:03:34,451 WARN [Listener at jenkins-hbase4.apache.org/36133] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-09-27 07:03:34,453 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 07:03:34,556 WARN [BP-317658032-172.31.14.131-1695798065216 heartbeating to localhost/127.0.0.1:35855] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-09-27 07:03:34,556 WARN [BP-317658032-172.31.14.131-1695798065216 heartbeating to localhost/127.0.0.1:35855] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-317658032-172.31.14.131-1695798065216 (Datanode Uuid da7e021d-0ea3-4749-8e47-72377e1c5617) service to localhost/127.0.0.1:35855 2023-09-27 07:03:34,556 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data1/current/BP-317658032-172.31.14.131-1695798065216] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 07:03:34,557 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/fc02dd41-d54c-6179-70f3-cc741d73a1ee/cluster_1dcef516-a642-9fe5-6d8f-54d402d4ee1a/dfs/data/data2/current/BP-317658032-172.31.14.131-1695798065216] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-09-27 07:03:34,578 INFO [Listener at jenkins-hbase4.apache.org/36133] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-09-27 07:03:34,704 INFO [Listener at jenkins-hbase4.apache.org/36133] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-09-27 07:03:34,794 INFO [Listener at jenkins-hbase4.apache.org/36133] hbase.HBaseTestingUtility(1293): Minicluster is down