2023-07-24 13:06:05,002 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 13:06:05,259 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83 2023-07-24 13:06:05,259 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestSecureExportSnapshot timeout: 13 mins 2023-07-24 13:06:05,308 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 13:06:05,630 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 13:06:05,630 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394, deleteOnExit=true 2023-07-24 13:06:05,631 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 13:06:05,631 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/test.cache.data in system properties and HBase conf 2023-07-24 13:06:05,632 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 13:06:05,633 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop.log.dir in system properties and HBase conf 2023-07-24 13:06:05,633 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 13:06:05,634 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 13:06:05,634 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 13:06:06,038 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 13:06:06,044 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 13:06:06,044 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 13:06:06,045 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 13:06:06,045 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 13:06:06,045 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 13:06:06,046 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 13:06:06,046 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 13:06:06,047 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 13:06:06,047 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 13:06:06,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/nfs.dump.dir in system properties and HBase conf 2023-07-24 13:06:06,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/java.io.tmpdir in system properties and HBase conf 2023-07-24 13:06:06,048 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 13:06:06,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 13:06:06,049 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 13:06:06,755 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 13:06:06,760 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 13:06:07,155 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 13:06:07,396 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 13:06:07,414 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:07,460 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:07,505 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/java.io.tmpdir/Jetty_localhost_45347_hdfs____rybdrz/webapp 2023-07-24 13:06:07,668 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45347 2023-07-24 13:06:07,679 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 13:06:07,679 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 13:06:08,266 WARN [Listener at localhost/35185] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 13:06:08,374 WARN [Listener at localhost/35185] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 13:06:08,402 WARN [Listener at localhost/35185] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:08,456 INFO [Listener at localhost/35185] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:08,465 INFO [Listener at localhost/35185] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/java.io.tmpdir/Jetty_localhost_41599_datanode____afq34v/webapp 2023-07-24 13:06:08,600 INFO [Listener at localhost/35185] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41599 2023-07-24 13:06:09,122 WARN [Listener at localhost/34013] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 13:06:09,157 WARN [Listener at localhost/34013] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 13:06:09,167 WARN [Listener at localhost/34013] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:09,169 INFO [Listener at localhost/34013] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:09,181 INFO [Listener at localhost/34013] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/java.io.tmpdir/Jetty_localhost_34087_datanode____.1t2nl7/webapp 2023-07-24 13:06:09,331 INFO [Listener at localhost/34013] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34087 2023-07-24 13:06:09,355 WARN [Listener at localhost/39045] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 13:06:09,422 WARN [Listener at localhost/39045] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 13:06:09,427 WARN [Listener at localhost/39045] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:09,431 INFO [Listener at localhost/39045] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:09,444 INFO [Listener at localhost/39045] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/java.io.tmpdir/Jetty_localhost_44997_datanode____nic16m/webapp 2023-07-24 13:06:09,627 INFO [Listener at localhost/39045] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44997 2023-07-24 13:06:09,650 WARN [Listener at localhost/35307] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 13:06:10,070 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x445e20d3772f51dc: Processing first storage report for DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d from datanode cf85e342-d15c-4b59-964b-42d18f0b2eed 2023-07-24 13:06:10,072 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x445e20d3772f51dc: from storage DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d node DatanodeRegistration(127.0.0.1:42217, datanodeUuid=cf85e342-d15c-4b59-964b-42d18f0b2eed, infoPort=37095, infoSecurePort=0, ipcPort=35307, storageInfo=lv=-57;cid=testClusterID;nsid=423104387;c=1690203966871), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,072 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x69fba8f6b0107f72: Processing first storage report for DS-642e6dec-d060-4e2e-bc67-0032693d3a39 from datanode 070d2424-ccd1-47e8-9c31-b4431c2b8a08 2023-07-24 13:06:10,073 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x69fba8f6b0107f72: from storage DS-642e6dec-d060-4e2e-bc67-0032693d3a39 node DatanodeRegistration(127.0.0.1:45801, datanodeUuid=070d2424-ccd1-47e8-9c31-b4431c2b8a08, infoPort=34733, infoSecurePort=0, ipcPort=39045, storageInfo=lv=-57;cid=testClusterID;nsid=423104387;c=1690203966871), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,073 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a7b9f107eb431b0: Processing first storage report for DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6 from datanode f9977a1f-66fd-4c19-8c83-4c83f9cd3f8d 2023-07-24 13:06:10,074 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a7b9f107eb431b0: from storage DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6 node DatanodeRegistration(127.0.0.1:46537, datanodeUuid=f9977a1f-66fd-4c19-8c83-4c83f9cd3f8d, infoPort=44583, infoSecurePort=0, ipcPort=34013, storageInfo=lv=-57;cid=testClusterID;nsid=423104387;c=1690203966871), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,074 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x445e20d3772f51dc: Processing first storage report for DS-05091961-9781-4336-995e-e690be3aa2cd from datanode cf85e342-d15c-4b59-964b-42d18f0b2eed 2023-07-24 13:06:10,074 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x445e20d3772f51dc: from storage DS-05091961-9781-4336-995e-e690be3aa2cd node DatanodeRegistration(127.0.0.1:42217, datanodeUuid=cf85e342-d15c-4b59-964b-42d18f0b2eed, infoPort=37095, infoSecurePort=0, ipcPort=35307, storageInfo=lv=-57;cid=testClusterID;nsid=423104387;c=1690203966871), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,074 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x69fba8f6b0107f72: Processing first storage report for DS-71ad288f-3855-418c-a07e-2f321f167949 from datanode 070d2424-ccd1-47e8-9c31-b4431c2b8a08 2023-07-24 13:06:10,074 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x69fba8f6b0107f72: from storage DS-71ad288f-3855-418c-a07e-2f321f167949 node DatanodeRegistration(127.0.0.1:45801, datanodeUuid=070d2424-ccd1-47e8-9c31-b4431c2b8a08, infoPort=34733, infoSecurePort=0, ipcPort=39045, storageInfo=lv=-57;cid=testClusterID;nsid=423104387;c=1690203966871), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,075 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5a7b9f107eb431b0: Processing first storage report for DS-ffa7d62a-40b9-416d-bb47-f671fd2a3d7a from datanode f9977a1f-66fd-4c19-8c83-4c83f9cd3f8d 2023-07-24 13:06:10,075 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5a7b9f107eb431b0: from storage DS-ffa7d62a-40b9-416d-bb47-f671fd2a3d7a node DatanodeRegistration(127.0.0.1:46537, datanodeUuid=f9977a1f-66fd-4c19-8c83-4c83f9cd3f8d, infoPort=44583, infoSecurePort=0, ipcPort=34013, storageInfo=lv=-57;cid=testClusterID;nsid=423104387;c=1690203966871), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 13:06:10,265 DEBUG [Listener at localhost/35307] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83 2023-07-24 13:06:10,357 INFO [Listener at localhost/35307] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/zookeeper_0, clientPort=59137, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 13:06:10,380 INFO [Listener at localhost/35307] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59137 2023-07-24 13:06:10,392 INFO [Listener at localhost/35307] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:10,395 INFO [Listener at localhost/35307] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:11,129 INFO [Listener at localhost/35307] util.FSUtils(471): Created version file at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 with version=8 2023-07-24 13:06:11,129 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/hbase-staging 2023-07-24 13:06:11,558 INFO [Listener at localhost/35307] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 13:06:12,093 INFO [Listener at localhost/35307] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 13:06:12,136 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,137 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,137 INFO [Listener at localhost/35307] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 13:06:12,137 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,137 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 13:06:12,314 INFO [Listener at localhost/35307] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 13:06:12,396 DEBUG [Listener at localhost/35307] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 13:06:12,502 INFO [Listener at localhost/35307] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42065 2023-07-24 13:06:12,517 INFO [Listener at localhost/35307] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:12,519 INFO [Listener at localhost/35307] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:12,545 INFO [Listener at localhost/35307] zookeeper.RecoverableZooKeeper(93): Process identifier=master:42065 connecting to ZooKeeper ensemble=127.0.0.1:59137 2023-07-24 13:06:12,615 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:420650x0, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 13:06:12,618 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:42065-0x10197705e200000 connected 2023-07-24 13:06:12,657 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 13:06:12,658 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:06:12,671 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 13:06:12,686 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42065 2023-07-24 13:06:12,687 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42065 2023-07-24 13:06:12,687 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42065 2023-07-24 13:06:12,694 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42065 2023-07-24 13:06:12,695 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42065 2023-07-24 13:06:12,704 INFO [Listener at localhost/35307] master.HMaster(444): hbase.rootdir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83, hbase.cluster.distributed=false 2023-07-24 13:06:12,795 INFO [Listener at localhost/35307] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 13:06:12,796 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,796 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,796 INFO [Listener at localhost/35307] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 13:06:12,797 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,797 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 13:06:12,803 INFO [Listener at localhost/35307] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 13:06:12,807 INFO [Listener at localhost/35307] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36751 2023-07-24 13:06:12,810 INFO [Listener at localhost/35307] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 13:06:12,824 DEBUG [Listener at localhost/35307] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 13:06:12,826 INFO [Listener at localhost/35307] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:12,828 INFO [Listener at localhost/35307] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:12,830 INFO [Listener at localhost/35307] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36751 connecting to ZooKeeper ensemble=127.0.0.1:59137 2023-07-24 13:06:12,841 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:367510x0, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 13:06:12,842 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): regionserver:367510x0, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 13:06:12,849 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): regionserver:367510x0, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:06:12,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36751-0x10197705e200001 connected 2023-07-24 13:06:12,851 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 13:06:12,856 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36751 2023-07-24 13:06:12,857 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36751 2023-07-24 13:06:12,860 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36751 2023-07-24 13:06:12,863 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36751 2023-07-24 13:06:12,863 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36751 2023-07-24 13:06:12,885 INFO [Listener at localhost/35307] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 13:06:12,885 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,886 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,886 INFO [Listener at localhost/35307] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 13:06:12,887 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,887 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 13:06:12,887 INFO [Listener at localhost/35307] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 13:06:12,896 INFO [Listener at localhost/35307] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36483 2023-07-24 13:06:12,897 INFO [Listener at localhost/35307] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 13:06:12,910 DEBUG [Listener at localhost/35307] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 13:06:12,912 INFO [Listener at localhost/35307] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:12,926 INFO [Listener at localhost/35307] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:12,928 INFO [Listener at localhost/35307] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36483 connecting to ZooKeeper ensemble=127.0.0.1:59137 2023-07-24 13:06:12,943 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:364830x0, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 13:06:12,944 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): regionserver:364830x0, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 13:06:12,945 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): regionserver:364830x0, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:06:12,946 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): regionserver:364830x0, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 13:06:12,954 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36483-0x10197705e200002 connected 2023-07-24 13:06:12,954 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36483 2023-07-24 13:06:12,954 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36483 2023-07-24 13:06:12,958 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36483 2023-07-24 13:06:12,959 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36483 2023-07-24 13:06:12,959 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36483 2023-07-24 13:06:12,979 INFO [Listener at localhost/35307] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 13:06:12,979 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,979 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,980 INFO [Listener at localhost/35307] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 13:06:12,980 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 13:06:12,980 INFO [Listener at localhost/35307] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 13:06:12,980 INFO [Listener at localhost/35307] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 13:06:12,986 INFO [Listener at localhost/35307] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43049 2023-07-24 13:06:12,992 INFO [Listener at localhost/35307] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 13:06:13,002 DEBUG [Listener at localhost/35307] mob.MobFileCache(120): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-07-24 13:06:13,004 INFO [Listener at localhost/35307] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:13,006 INFO [Listener at localhost/35307] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:13,007 INFO [Listener at localhost/35307] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43049 connecting to ZooKeeper ensemble=127.0.0.1:59137 2023-07-24 13:06:13,015 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:430490x0, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 13:06:13,016 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): regionserver:430490x0, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 13:06:13,017 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): regionserver:430490x0, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:06:13,018 DEBUG [Listener at localhost/35307] zookeeper.ZKUtil(164): regionserver:430490x0, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 13:06:13,023 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43049-0x10197705e200003 connected 2023-07-24 13:06:13,027 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43049 2023-07-24 13:06:13,028 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43049 2023-07-24 13:06:13,028 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43049 2023-07-24 13:06:13,029 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43049 2023-07-24 13:06:13,030 DEBUG [Listener at localhost/35307] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43049 2023-07-24 13:06:13,035 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,42065,1690203971321 2023-07-24 13:06:13,045 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 13:06:13,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,42065,1690203971321 2023-07-24 13:06:13,077 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 13:06:13,077 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 13:06:13,077 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 13:06:13,078 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 13:06:13,077 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:13,087 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 13:06:13,091 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 13:06:13,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,42065,1690203971321 from backup master directory 2023-07-24 13:06:13,098 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,42065,1690203971321 2023-07-24 13:06:13,099 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 13:06:13,099 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 13:06:13,100 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,42065,1690203971321 2023-07-24 13:06:13,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 13:06:13,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 13:06:13,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/hbase.id with ID: a8549b69-f75f-418a-9106-33cebbc69f71 2023-07-24 13:06:13,276 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 13:06:13,294 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:13,367 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x51eef03f to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:13,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@51cc1a4e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:13,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:13,445 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 13:06:13,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 13:06:13,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 13:06:13,469 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 13:06:13,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 13:06:13,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 13:06:13,515 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/data/master/store-tmp 2023-07-24 13:06:13,561 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:13,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 13:06:13,562 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:06:13,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:06:13,562 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 13:06:13,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:06:13,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:06:13,563 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 13:06:13,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/WALs/jenkins-hbase4.apache.org,42065,1690203971321 2023-07-24 13:06:13,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42065%2C1690203971321, suffix=, logDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/WALs/jenkins-hbase4.apache.org,42065,1690203971321, archiveDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/oldWALs, maxLogs=10 2023-07-24 13:06:13,672 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46537,DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6,DISK] 2023-07-24 13:06:13,673 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45801,DS-642e6dec-d060-4e2e-bc67-0032693d3a39,DISK] 2023-07-24 13:06:13,672 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42217,DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d,DISK] 2023-07-24 13:06:13,682 DEBUG [RS-EventLoopGroup-5-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 13:06:13,781 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/WALs/jenkins-hbase4.apache.org,42065,1690203971321/jenkins-hbase4.apache.org%2C42065%2C1690203971321.1690203973612 2023-07-24 13:06:13,787 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46537,DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6,DISK], DatanodeInfoWithStorage[127.0.0.1:45801,DS-642e6dec-d060-4e2e-bc67-0032693d3a39,DISK], DatanodeInfoWithStorage[127.0.0.1:42217,DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d,DISK]] 2023-07-24 13:06:13,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 13:06:13,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:13,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:13,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:13,901 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:13,910 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 13:06:13,949 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 13:06:13,964 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:13,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:13,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:13,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 13:06:14,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:14,004 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70899364, jitterRate=0.05648285150527954}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:14,004 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 13:06:14,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 13:06:14,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 13:06:14,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 13:06:14,041 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 13:06:14,044 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 2 msec 2023-07-24 13:06:14,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 53 msec 2023-07-24 13:06:14,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 13:06:14,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 13:06:14,144 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 13:06:14,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 13:06:14,176 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 13:06:14,178 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 13:06:14,184 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 13:06:14,189 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 13:06:14,193 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:14,194 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 13:06:14,195 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 13:06:14,214 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 13:06:14,220 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 13:06:14,220 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 13:06:14,220 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 13:06:14,220 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 13:06:14,221 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:14,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,42065,1690203971321, sessionid=0x10197705e200000, setting cluster-up flag (Was=false) 2023-07-24 13:06:14,244 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:14,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 13:06:14,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42065,1690203971321 2023-07-24 13:06:14,266 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:14,272 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 13:06:14,274 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,42065,1690203971321 2023-07-24 13:06:14,278 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp 2023-07-24 13:06:14,336 INFO [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(951): ClusterId : a8549b69-f75f-418a-9106-33cebbc69f71 2023-07-24 13:06:14,339 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(951): ClusterId : a8549b69-f75f-418a-9106-33cebbc69f71 2023-07-24 13:06:14,338 INFO [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(951): ClusterId : a8549b69-f75f-418a-9106-33cebbc69f71 2023-07-24 13:06:14,344 DEBUG [RS:0;jenkins-hbase4:36751] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 13:06:14,344 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 13:06:14,344 DEBUG [RS:2;jenkins-hbase4:43049] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 13:06:14,354 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 13:06:14,354 DEBUG [RS:2;jenkins-hbase4:43049] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 13:06:14,354 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 13:06:14,355 DEBUG [RS:0;jenkins-hbase4:36751] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 13:06:14,355 DEBUG [RS:0;jenkins-hbase4:36751] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 13:06:14,355 DEBUG [RS:2;jenkins-hbase4:43049] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 13:06:14,363 DEBUG [RS:2;jenkins-hbase4:43049] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 13:06:14,364 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 13:06:14,366 DEBUG [RS:2;jenkins-hbase4:43049] zookeeper.ReadOnlyZKClient(139): Connect 0x23520e65 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:14,370 DEBUG [RS:0;jenkins-hbase4:36751] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 13:06:14,375 DEBUG [RS:0;jenkins-hbase4:36751] zookeeper.ReadOnlyZKClient(139): Connect 0x6f2a1dcd to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:14,377 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ReadOnlyZKClient(139): Connect 0x2411f5c7 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:14,403 DEBUG [RS:2;jenkins-hbase4:43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2d95e47f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:14,404 DEBUG [RS:2;jenkins-hbase4:43049] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29aa6515, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 13:06:14,412 DEBUG [RS:0;jenkins-hbase4:36751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@61edfe58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:14,413 DEBUG [RS:0;jenkins-hbase4:36751] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65d276bd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 13:06:14,425 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 13:06:14,458 DEBUG [RS:1;jenkins-hbase4:36483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ad60f35, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:14,459 DEBUG [RS:1;jenkins-hbase4:36483] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ee99eb7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 13:06:14,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:14,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 13:06:14,490 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:43049 2023-07-24 13:06:14,494 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:36483 2023-07-24 13:06:14,492 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36751 2023-07-24 13:06:14,497 INFO [RS:2;jenkins-hbase4:43049] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 13:06:14,498 INFO [RS:0;jenkins-hbase4:36751] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 13:06:14,498 INFO [RS:0;jenkins-hbase4:36751] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 13:06:14,498 INFO [RS:2;jenkins-hbase4:43049] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 13:06:14,499 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 13:06:14,499 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 13:06:14,497 INFO [RS:1;jenkins-hbase4:36483] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 13:06:14,500 INFO [RS:0;jenkins-hbase4:36751] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:14,500 INFO [RS:2;jenkins-hbase4:43049] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:14,501 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 13:06:14,500 INFO [RS:1;jenkins-hbase4:36483] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 13:06:14,501 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 13:06:14,501 INFO [RS:1;jenkins-hbase4:36483] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:14,501 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 13:06:14,501 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 13:06:14,504 INFO [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42065,1690203971321 with isa=jenkins-hbase4.apache.org/172.31.14.131:43049, startcode=1690203972978 2023-07-24 13:06:14,504 INFO [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42065,1690203971321 with isa=jenkins-hbase4.apache.org/172.31.14.131:36751, startcode=1690203972794 2023-07-24 13:06:14,504 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42065,1690203971321 with isa=jenkins-hbase4.apache.org/172.31.14.131:36483, startcode=1690203972884 2023-07-24 13:06:14,526 DEBUG [RS:0;jenkins-hbase4:36751] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 13:06:14,528 DEBUG [RS:2;jenkins-hbase4:43049] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 13:06:14,527 DEBUG [RS:1;jenkins-hbase4:36483] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 13:06:14,595 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 13:06:14,615 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38171, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 13:06:14,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 13:06:14,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 13:06:14,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 13:06:14,616 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 13:06:14,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 13:06:14,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 13:06:14,617 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,619 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47583, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 13:06:14,620 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60839, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 13:06:14,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690204004633 2023-07-24 13:06:14,635 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42065] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 13:06:14,636 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 13:06:14,646 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42065] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 13:06:14,648 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42065] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 13:06:14,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 13:06:14,663 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 13:06:14,663 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 13:06:14,675 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:14,682 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 13:06:14,682 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 13:06:14,683 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 13:06:14,682 WARN [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 13:06:14,683 WARN [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 13:06:14,683 WARN [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 13:06:14,683 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 13:06:14,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 13:06:14,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 13:06:14,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 13:06:14,687 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,690 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 13:06:14,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 13:06:14,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 13:06:14,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 13:06:14,699 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 13:06:14,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690203974702,5,FailOnTimeoutGroup] 2023-07-24 13:06:14,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690203974703,5,FailOnTimeoutGroup] 2023-07-24 13:06:14,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 13:06:14,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,749 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:14,753 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:14,754 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:06:14,784 INFO [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42065,1690203971321 with isa=jenkins-hbase4.apache.org/172.31.14.131:43049, startcode=1690203972978 2023-07-24 13:06:14,784 INFO [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42065,1690203971321 with isa=jenkins-hbase4.apache.org/172.31.14.131:36751, startcode=1690203972794 2023-07-24 13:06:14,784 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,42065,1690203971321 with isa=jenkins-hbase4.apache.org/172.31.14.131:36483, startcode=1690203972884 2023-07-24 13:06:14,793 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42065] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:14,796 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:14,800 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42065] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:14,800 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 13:06:14,802 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:06:14,802 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=42065] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:14,803 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35185 2023-07-24 13:06:14,804 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 13:06:14,804 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:06:14,805 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35185 2023-07-24 13:06:14,805 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 13:06:14,812 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:06:14,812 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:06:14,812 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:35185 2023-07-24 13:06:14,812 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 13:06:14,820 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ZKUtil(162): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:14,820 WARN [RS:1;jenkins-hbase4:36483] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 13:06:14,821 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/info 2023-07-24 13:06:14,821 INFO [RS:1;jenkins-hbase4:36483] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 13:06:14,821 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:14,822 DEBUG [RS:2;jenkins-hbase4:43049] zookeeper.ZKUtil(162): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:14,822 DEBUG [RS:0;jenkins-hbase4:36751] zookeeper.ZKUtil(162): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:14,823 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36483,1690203972884] 2023-07-24 13:06:14,823 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 13:06:14,823 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36751,1690203972794] 2023-07-24 13:06:14,823 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43049,1690203972978] 2023-07-24 13:06:14,824 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:14,822 WARN [RS:0;jenkins-hbase4:36751] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 13:06:14,822 WARN [RS:2;jenkins-hbase4:43049] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 13:06:14,840 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 13:06:14,840 INFO [RS:0;jenkins-hbase4:36751] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 13:06:14,840 INFO [RS:2;jenkins-hbase4:43049] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 13:06:14,843 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:14,843 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1948): logDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:14,862 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ZKUtil(162): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:14,862 DEBUG [RS:2;jenkins-hbase4:43049] zookeeper.ZKUtil(162): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:14,865 DEBUG [RS:0;jenkins-hbase4:36751] zookeeper.ZKUtil(162): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:14,866 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ZKUtil(162): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:14,866 DEBUG [RS:0;jenkins-hbase4:36751] zookeeper.ZKUtil(162): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:14,866 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/rep_barrier 2023-07-24 13:06:14,866 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ZKUtil(162): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:14,867 DEBUG [RS:0;jenkins-hbase4:36751] zookeeper.ZKUtil(162): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:14,870 DEBUG [RS:2;jenkins-hbase4:43049] zookeeper.ZKUtil(162): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:14,873 DEBUG [RS:2;jenkins-hbase4:43049] zookeeper.ZKUtil(162): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:14,873 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 13:06:14,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:14,876 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 13:06:14,880 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/table 2023-07-24 13:06:14,880 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 13:06:14,881 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:14,885 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 13:06:14,885 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 13:06:14,885 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 13:06:14,885 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740 2023-07-24 13:06:14,890 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740 2023-07-24 13:06:14,895 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 13:06:14,898 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 13:06:14,901 INFO [RS:2;jenkins-hbase4:43049] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 13:06:14,901 INFO [RS:1;jenkins-hbase4:36483] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 13:06:14,902 INFO [RS:0;jenkins-hbase4:36751] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 13:06:14,906 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:14,907 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74372812, jitterRate=0.1082412600517273}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 13:06:14,908 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 13:06:14,908 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 13:06:14,908 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 13:06:14,908 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 13:06:14,908 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 13:06:14,908 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 13:06:14,918 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 13:06:14,918 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 13:06:14,928 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 13:06:14,929 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 13:06:14,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 13:06:14,945 INFO [RS:2;jenkins-hbase4:43049] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 13:06:14,949 INFO [RS:1;jenkins-hbase4:36483] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 13:06:14,951 INFO [RS:0;jenkins-hbase4:36751] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 13:06:14,955 INFO [RS:2;jenkins-hbase4:43049] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 13:06:14,959 INFO [RS:2;jenkins-hbase4:43049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,955 INFO [RS:1;jenkins-hbase4:36483] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 13:06:14,955 INFO [RS:0;jenkins-hbase4:36751] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 13:06:14,959 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,959 INFO [RS:0;jenkins-hbase4:36751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,960 INFO [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 13:06:14,961 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 13:06:14,969 INFO [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 13:06:14,969 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 13:06:14,977 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,977 INFO [RS:2;jenkins-hbase4:43049] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,977 INFO [RS:0;jenkins-hbase4:36751] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,977 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,977 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,977 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,978 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,978 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,978 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 13:06:14,978 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,978 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,978 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,978 DEBUG [RS:1;jenkins-hbase4:36483] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,977 DEBUG [RS:2;jenkins-hbase4:43049] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,982 DEBUG [RS:2;jenkins-hbase4:43049] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,977 DEBUG [RS:0;jenkins-hbase4:36751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,982 DEBUG [RS:0;jenkins-hbase4:36751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,982 DEBUG [RS:0;jenkins-hbase4:36751] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,983 DEBUG [RS:2;jenkins-hbase4:43049] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,983 DEBUG [RS:0;jenkins-hbase4:36751] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,983 DEBUG [RS:0;jenkins-hbase4:36751] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,983 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 13:06:14,983 DEBUG [RS:0;jenkins-hbase4:36751] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 13:06:14,983 DEBUG [RS:0;jenkins-hbase4:36751] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,984 DEBUG [RS:0;jenkins-hbase4:36751] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,984 DEBUG [RS:0;jenkins-hbase4:36751] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,984 DEBUG [RS:0;jenkins-hbase4:36751] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,984 DEBUG [RS:2;jenkins-hbase4:43049] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,984 DEBUG [RS:2;jenkins-hbase4:43049] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,984 DEBUG [RS:2;jenkins-hbase4:43049] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 13:06:14,985 DEBUG [RS:2;jenkins-hbase4:43049] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,985 DEBUG [RS:2;jenkins-hbase4:43049] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,985 DEBUG [RS:2;jenkins-hbase4:43049] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,985 DEBUG [RS:2;jenkins-hbase4:43049] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 13:06:14,985 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,985 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:14,986 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,018 INFO [RS:2;jenkins-hbase4:43049] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,019 INFO [RS:2;jenkins-hbase4:43049] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,019 INFO [RS:2;jenkins-hbase4:43049] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,032 INFO [RS:1;jenkins-hbase4:36483] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 13:06:15,035 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36483,1690203972884-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,043 INFO [RS:0;jenkins-hbase4:36751] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,043 INFO [RS:0;jenkins-hbase4:36751] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,043 INFO [RS:0;jenkins-hbase4:36751] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,064 INFO [RS:2;jenkins-hbase4:43049] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 13:06:15,064 INFO [RS:2;jenkins-hbase4:43049] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43049,1690203972978-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,077 INFO [RS:0;jenkins-hbase4:36751] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 13:06:15,077 INFO [RS:0;jenkins-hbase4:36751] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36751,1690203972794-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,098 INFO [RS:1;jenkins-hbase4:36483] regionserver.Replication(203): jenkins-hbase4.apache.org,36483,1690203972884 started 2023-07-24 13:06:15,099 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36483,1690203972884, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36483, sessionid=0x10197705e200002 2023-07-24 13:06:15,099 INFO [RS:2;jenkins-hbase4:43049] regionserver.Replication(203): jenkins-hbase4.apache.org,43049,1690203972978 started 2023-07-24 13:06:15,099 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 13:06:15,099 INFO [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,43049,1690203972978, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43049, sessionid=0x10197705e200003 2023-07-24 13:06:15,099 DEBUG [RS:1;jenkins-hbase4:36483] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:15,099 DEBUG [RS:2;jenkins-hbase4:43049] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 13:06:15,099 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36483,1690203972884' 2023-07-24 13:06:15,100 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 13:06:15,102 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 13:06:15,102 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 13:06:15,103 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 13:06:15,103 DEBUG [RS:1;jenkins-hbase4:36483] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:15,103 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36483,1690203972884' 2023-07-24 13:06:15,103 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:15,100 DEBUG [RS:2;jenkins-hbase4:43049] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:15,103 DEBUG [RS:1;jenkins-hbase4:36483] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:15,104 DEBUG [RS:2;jenkins-hbase4:43049] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43049,1690203972978' 2023-07-24 13:06:15,107 DEBUG [RS:2;jenkins-hbase4:43049] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 13:06:15,107 DEBUG [RS:1;jenkins-hbase4:36483] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 13:06:15,107 INFO [RS:1;jenkins-hbase4:36483] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 13:06:15,107 DEBUG [RS:2;jenkins-hbase4:43049] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 13:06:15,108 INFO [RS:1;jenkins-hbase4:36483] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 13:06:15,108 DEBUG [RS:2;jenkins-hbase4:43049] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 13:06:15,108 DEBUG [RS:2;jenkins-hbase4:43049] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 13:06:15,108 DEBUG [RS:2;jenkins-hbase4:43049] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:15,109 DEBUG [RS:2;jenkins-hbase4:43049] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43049,1690203972978' 2023-07-24 13:06:15,109 DEBUG [RS:2;jenkins-hbase4:43049] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:15,109 DEBUG [RS:2;jenkins-hbase4:43049] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:15,110 DEBUG [RS:2;jenkins-hbase4:43049] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 13:06:15,115 INFO [RS:0;jenkins-hbase4:36751] regionserver.Replication(203): jenkins-hbase4.apache.org,36751,1690203972794 started 2023-07-24 13:06:15,115 INFO [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,36751,1690203972794, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36751, sessionid=0x10197705e200001 2023-07-24 13:06:15,115 DEBUG [RS:0;jenkins-hbase4:36751] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 13:06:15,115 DEBUG [RS:0;jenkins-hbase4:36751] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:15,116 DEBUG [RS:0;jenkins-hbase4:36751] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36751,1690203972794' 2023-07-24 13:06:15,116 DEBUG [RS:0;jenkins-hbase4:36751] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 13:06:15,110 INFO [RS:2;jenkins-hbase4:43049] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 13:06:15,116 INFO [RS:2;jenkins-hbase4:43049] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 13:06:15,119 DEBUG [RS:0;jenkins-hbase4:36751] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 13:06:15,120 DEBUG [RS:0;jenkins-hbase4:36751] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 13:06:15,120 DEBUG [RS:0;jenkins-hbase4:36751] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 13:06:15,120 DEBUG [RS:0;jenkins-hbase4:36751] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:15,120 DEBUG [RS:0;jenkins-hbase4:36751] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36751,1690203972794' 2023-07-24 13:06:15,120 DEBUG [RS:0;jenkins-hbase4:36751] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:15,121 DEBUG [RS:0;jenkins-hbase4:36751] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:15,122 DEBUG [RS:0;jenkins-hbase4:36751] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 13:06:15,122 INFO [RS:0;jenkins-hbase4:36751] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 13:06:15,122 INFO [RS:0;jenkins-hbase4:36751] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 13:06:15,195 DEBUG [jenkins-hbase4:42065] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 13:06:15,201 DEBUG [jenkins-hbase4:42065] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:15,209 DEBUG [jenkins-hbase4:42065] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:15,209 DEBUG [jenkins-hbase4:42065] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:15,209 DEBUG [jenkins-hbase4:42065] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:15,209 DEBUG [jenkins-hbase4:42065] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:15,217 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43049,1690203972978, state=OPENING 2023-07-24 13:06:15,220 INFO [RS:1;jenkins-hbase4:36483] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36483%2C1690203972884, suffix=, logDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,36483,1690203972884, archiveDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/oldWALs, maxLogs=32 2023-07-24 13:06:15,221 INFO [RS:2;jenkins-hbase4:43049] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43049%2C1690203972978, suffix=, logDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,43049,1690203972978, archiveDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/oldWALs, maxLogs=32 2023-07-24 13:06:15,225 DEBUG [PEWorker-5] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 13:06:15,226 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:15,227 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 13:06:15,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:06:15,233 INFO [RS:0;jenkins-hbase4:36751] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36751%2C1690203972794, suffix=, logDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,36751,1690203972794, archiveDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/oldWALs, maxLogs=32 2023-07-24 13:06:15,262 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42217,DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d,DISK] 2023-07-24 13:06:15,275 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46537,DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6,DISK] 2023-07-24 13:06:15,276 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45801,DS-642e6dec-d060-4e2e-bc67-0032693d3a39,DISK] 2023-07-24 13:06:15,276 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42217,DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d,DISK] 2023-07-24 13:06:15,277 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45801,DS-642e6dec-d060-4e2e-bc67-0032693d3a39,DISK] 2023-07-24 13:06:15,277 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46537,DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6,DISK] 2023-07-24 13:06:15,294 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46537,DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6,DISK] 2023-07-24 13:06:15,294 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42217,DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d,DISK] 2023-07-24 13:06:15,295 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45801,DS-642e6dec-d060-4e2e-bc67-0032693d3a39,DISK] 2023-07-24 13:06:15,303 INFO [RS:2;jenkins-hbase4:43049] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,43049,1690203972978/jenkins-hbase4.apache.org%2C43049%2C1690203972978.1690203975224 2023-07-24 13:06:15,303 INFO [RS:1;jenkins-hbase4:36483] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,36483,1690203972884/jenkins-hbase4.apache.org%2C36483%2C1690203972884.1690203975229 2023-07-24 13:06:15,329 DEBUG [RS:2;jenkins-hbase4:43049] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42217,DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d,DISK], DatanodeInfoWithStorage[127.0.0.1:46537,DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6,DISK], DatanodeInfoWithStorage[127.0.0.1:45801,DS-642e6dec-d060-4e2e-bc67-0032693d3a39,DISK]] 2023-07-24 13:06:15,329 DEBUG [RS:1;jenkins-hbase4:36483] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45801,DS-642e6dec-d060-4e2e-bc67-0032693d3a39,DISK], DatanodeInfoWithStorage[127.0.0.1:42217,DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d,DISK], DatanodeInfoWithStorage[127.0.0.1:46537,DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6,DISK]] 2023-07-24 13:06:15,331 INFO [RS:0;jenkins-hbase4:36751] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,36751,1690203972794/jenkins-hbase4.apache.org%2C36751%2C1690203972794.1690203975235 2023-07-24 13:06:15,342 DEBUG [RS:0;jenkins-hbase4:36751] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42217,DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d,DISK], DatanodeInfoWithStorage[127.0.0.1:45801,DS-642e6dec-d060-4e2e-bc67-0032693d3a39,DISK], DatanodeInfoWithStorage[127.0.0.1:46537,DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6,DISK]] 2023-07-24 13:06:15,471 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:15,475 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:06:15,482 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56596, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:06:15,507 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 13:06:15,508 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 13:06:15,512 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43049%2C1690203972978.meta, suffix=.meta, logDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,43049,1690203972978, archiveDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/oldWALs, maxLogs=32 2023-07-24 13:06:15,537 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46537,DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6,DISK] 2023-07-24 13:06:15,538 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45801,DS-642e6dec-d060-4e2e-bc67-0032693d3a39,DISK] 2023-07-24 13:06:15,538 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42217,DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d,DISK] 2023-07-24 13:06:15,545 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/WALs/jenkins-hbase4.apache.org,43049,1690203972978/jenkins-hbase4.apache.org%2C43049%2C1690203972978.meta.1690203975514.meta 2023-07-24 13:06:15,546 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46537,DS-ae0d9e81-243e-453e-bcd2-9332f8cbe5f6,DISK], DatanodeInfoWithStorage[127.0.0.1:42217,DS-6dfdb9b5-f9b5-4c3e-950c-42100d89211d,DISK], DatanodeInfoWithStorage[127.0.0.1:45801,DS-642e6dec-d060-4e2e-bc67-0032693d3a39,DISK]] 2023-07-24 13:06:15,547 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 13:06:15,548 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 13:06:15,549 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:15,550 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 13:06:15,552 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 13:06:15,553 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 13:06:15,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 13:06:15,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:15,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 13:06:15,569 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 13:06:15,573 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 13:06:15,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/info 2023-07-24 13:06:15,575 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/info 2023-07-24 13:06:15,576 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 13:06:15,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:15,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 13:06:15,579 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/rep_barrier 2023-07-24 13:06:15,579 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/rep_barrier 2023-07-24 13:06:15,580 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 13:06:15,581 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:15,581 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 13:06:15,583 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/table 2023-07-24 13:06:15,583 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/table 2023-07-24 13:06:15,583 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 13:06:15,584 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:15,587 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740 2023-07-24 13:06:15,590 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740 2023-07-24 13:06:15,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 13:06:15,597 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 13:06:15,599 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69792035, jitterRate=0.03998236358165741}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 13:06:15,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 13:06:15,612 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690203975458 2023-07-24 13:06:15,632 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 13:06:15,634 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 13:06:15,634 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43049,1690203972978, state=OPEN 2023-07-24 13:06:15,639 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 13:06:15,639 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 13:06:15,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 13:06:15,646 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43049,1690203972978 in 406 msec 2023-07-24 13:06:15,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 13:06:15,654 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 706 msec 2023-07-24 13:06:15,661 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.1860 sec 2023-07-24 13:06:15,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690203975661, completionTime=-1 2023-07-24 13:06:15,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 13:06:15,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 13:06:15,753 DEBUG [hconnection-0x7dc11d1a-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:15,757 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:15,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 13:06:15,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690204035792 2023-07-24 13:06:15,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690204095792 2023-07-24 13:06:15,792 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 130 msec 2023-07-24 13:06:15,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42065,1690203971321-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42065,1690203971321-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42065,1690203971321-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,826 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:42065, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 13:06:15,841 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 13:06:15,849 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 13:06:15,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:15,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 13:06:15,870 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:06:15,875 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:06:15,907 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:06:15,911 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8 empty. 2023-07-24 13:06:15,912 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:06:15,912 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 13:06:15,973 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:15,976 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 938e272863b8cbff56246ac36d5f8fe8, NAME => 'hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:06:16,003 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:16,003 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 938e272863b8cbff56246ac36d5f8fe8, disabling compactions & flushes 2023-07-24 13:06:16,003 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:06:16,003 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:06:16,003 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. after waiting 0 ms 2023-07-24 13:06:16,003 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:06:16,003 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:06:16,003 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 938e272863b8cbff56246ac36d5f8fe8: 2023-07-24 13:06:16,009 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:06:16,029 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690203976013"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690203976013"}]},"ts":"1690203976013"} 2023-07-24 13:06:16,068 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 13:06:16,071 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:06:16,077 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203976071"}]},"ts":"1690203976071"} 2023-07-24 13:06:16,090 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 13:06:16,098 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:16,099 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:16,099 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:16,100 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:16,100 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:16,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=938e272863b8cbff56246ac36d5f8fe8, ASSIGN}] 2023-07-24 13:06:16,112 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=938e272863b8cbff56246ac36d5f8fe8, ASSIGN 2023-07-24 13:06:16,114 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=938e272863b8cbff56246ac36d5f8fe8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36751,1690203972794; forceNewPlan=false, retain=false 2023-07-24 13:06:16,267 INFO [jenkins-hbase4:42065] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 13:06:16,268 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=938e272863b8cbff56246ac36d5f8fe8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:16,269 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690203976268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690203976268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690203976268"}]},"ts":"1690203976268"} 2023-07-24 13:06:16,273 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 938e272863b8cbff56246ac36d5f8fe8, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:06:16,428 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:16,428 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:06:16,431 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:06:16,438 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:06:16,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 938e272863b8cbff56246ac36d5f8fe8, NAME => 'hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8.', STARTKEY => '', ENDKEY => ''} 2023-07-24 13:06:16,438 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. service=AccessControlService 2023-07-24 13:06:16,439 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:16,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:06:16,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:16,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:06:16,440 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:06:16,442 INFO [StoreOpener-938e272863b8cbff56246ac36d5f8fe8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:06:16,445 DEBUG [StoreOpener-938e272863b8cbff56246ac36d5f8fe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8/info 2023-07-24 13:06:16,445 DEBUG [StoreOpener-938e272863b8cbff56246ac36d5f8fe8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8/info 2023-07-24 13:06:16,445 INFO [StoreOpener-938e272863b8cbff56246ac36d5f8fe8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 938e272863b8cbff56246ac36d5f8fe8 columnFamilyName info 2023-07-24 13:06:16,446 INFO [StoreOpener-938e272863b8cbff56246ac36d5f8fe8-1] regionserver.HStore(310): Store=938e272863b8cbff56246ac36d5f8fe8/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:16,448 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:06:16,449 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:06:16,454 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:06:16,457 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:16,458 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 938e272863b8cbff56246ac36d5f8fe8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73018960, jitterRate=0.08806729316711426}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:16,458 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 938e272863b8cbff56246ac36d5f8fe8: 2023-07-24 13:06:16,460 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8., pid=6, masterSystemTime=1690203976428 2023-07-24 13:06:16,465 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:06:16,465 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:06:16,467 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=938e272863b8cbff56246ac36d5f8fe8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:16,467 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690203976466"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690203976466"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690203976466"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690203976466"}]},"ts":"1690203976466"} 2023-07-24 13:06:16,476 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 13:06:16,477 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 938e272863b8cbff56246ac36d5f8fe8, server=jenkins-hbase4.apache.org,36751,1690203972794 in 199 msec 2023-07-24 13:06:16,481 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 13:06:16,483 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=938e272863b8cbff56246ac36d5f8fe8, ASSIGN in 374 msec 2023-07-24 13:06:16,484 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:06:16,484 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203976484"}]},"ts":"1690203976484"} 2023-07-24 13:06:16,486 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 13:06:16,489 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:06:16,493 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 638 msec 2023-07-24 13:06:16,568 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 13:06:16,570 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 13:06:16,570 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:16,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:16,594 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35116, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:16,608 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 13:06:16,627 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 13:06:16,634 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2023-07-24 13:06:16,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 13:06:16,653 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 13:06:16,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2023-07-24 13:06:16,670 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 13:06:16,673 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 13:06:16,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.573sec 2023-07-24 13:06:16,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 13:06:16,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 13:06:16,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 13:06:16,681 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42065,1690203971321-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 13:06:16,682 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42065,1690203971321-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 13:06:16,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:16,710 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 13:06:16,713 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:06:16,714 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:06:16,717 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:06:16,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 13:06:16,718 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f empty. 2023-07-24 13:06:16,720 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:06:16,720 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 13:06:16,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 13:06:16,742 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:16,744 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3326ec7ed9f21fb6c68e628d8708a54f, NAME => 'hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:06:16,745 DEBUG [Listener at localhost/35307] zookeeper.ReadOnlyZKClient(139): Connect 0x776a4d8e to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:16,752 DEBUG [Listener at localhost/35307] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5057d4c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:16,779 DEBUG [hconnection-0xe8fab10-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:16,785 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:16,785 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 3326ec7ed9f21fb6c68e628d8708a54f, disabling compactions & flushes 2023-07-24 13:06:16,785 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:06:16,785 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:06:16,785 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. after waiting 0 ms 2023-07-24 13:06:16,785 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:06:16,785 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:06:16,785 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 3326ec7ed9f21fb6c68e628d8708a54f: 2023-07-24 13:06:16,793 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:06:16,796 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690203976796"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690203976796"}]},"ts":"1690203976796"} 2023-07-24 13:06:16,798 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56614, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:16,801 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 13:06:16,803 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,42065,1690203971321 2023-07-24 13:06:16,803 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:06:16,803 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 13:06:16,803 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203976803"}]},"ts":"1690203976803"} 2023-07-24 13:06:16,804 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/test.cache.data in system properties and HBase conf 2023-07-24 13:06:16,804 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 13:06:16,804 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop.log.dir in system properties and HBase conf 2023-07-24 13:06:16,804 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 13:06:16,804 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 13:06:16,804 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 13:06:16,805 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 13:06:16,805 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 13:06:16,805 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 13:06:16,805 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 13:06:16,805 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 13:06:16,805 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 13:06:16,806 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 13:06:16,806 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 13:06:16,806 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 13:06:16,806 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/nfs.dump.dir in system properties and HBase conf 2023-07-24 13:06:16,806 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/java.io.tmpdir in system properties and HBase conf 2023-07-24 13:06:16,806 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 13:06:16,806 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 13:06:16,806 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 13:06:16,807 INFO [Listener at localhost/35307] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 13:06:16,812 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:16,813 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:16,814 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:16,814 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:16,814 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:16,814 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=3326ec7ed9f21fb6c68e628d8708a54f, ASSIGN}] 2023-07-24 13:06:16,817 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=3326ec7ed9f21fb6c68e628d8708a54f, ASSIGN 2023-07-24 13:06:16,819 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=3326ec7ed9f21fb6c68e628d8708a54f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36483,1690203972884; forceNewPlan=false, retain=false 2023-07-24 13:06:16,829 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 13:06:16,969 INFO [jenkins-hbase4:42065] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 13:06:16,971 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3326ec7ed9f21fb6c68e628d8708a54f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:16,971 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690203976970"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690203976970"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690203976970"}]},"ts":"1690203976970"} 2023-07-24 13:06:16,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 3326ec7ed9f21fb6c68e628d8708a54f, server=jenkins-hbase4.apache.org,36483,1690203972884}] 2023-07-24 13:06:17,029 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 13:06:17,139 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:17,139 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:06:17,147 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:06:17,161 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:06:17,161 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3326ec7ed9f21fb6c68e628d8708a54f, NAME => 'hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f.', STARTKEY => '', ENDKEY => ''} 2023-07-24 13:06:17,161 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. service=AccessControlService 2023-07-24 13:06:17,162 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:17,162 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:06:17,162 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:17,162 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:06:17,162 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:06:17,167 INFO [StoreOpener-3326ec7ed9f21fb6c68e628d8708a54f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:06:17,171 DEBUG [StoreOpener-3326ec7ed9f21fb6c68e628d8708a54f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f/l 2023-07-24 13:06:17,171 DEBUG [StoreOpener-3326ec7ed9f21fb6c68e628d8708a54f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f/l 2023-07-24 13:06:17,172 INFO [StoreOpener-3326ec7ed9f21fb6c68e628d8708a54f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3326ec7ed9f21fb6c68e628d8708a54f columnFamilyName l 2023-07-24 13:06:17,174 INFO [StoreOpener-3326ec7ed9f21fb6c68e628d8708a54f-1] regionserver.HStore(310): Store=3326ec7ed9f21fb6c68e628d8708a54f/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:17,177 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:06:17,178 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:06:17,187 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:06:17,192 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:17,193 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3326ec7ed9f21fb6c68e628d8708a54f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66820861, jitterRate=-0.0042915791273117065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:17,195 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3326ec7ed9f21fb6c68e628d8708a54f: 2023-07-24 13:06:17,197 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f., pid=11, masterSystemTime=1690203977139 2023-07-24 13:06:17,203 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:06:17,209 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:06:17,215 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3326ec7ed9f21fb6c68e628d8708a54f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:17,215 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690203977214"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690203977214"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690203977214"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690203977214"}]},"ts":"1690203977214"} 2023-07-24 13:06:17,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 13:06:17,226 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 3326ec7ed9f21fb6c68e628d8708a54f, server=jenkins-hbase4.apache.org,36483,1690203972884 in 245 msec 2023-07-24 13:06:17,232 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 13:06:17,232 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=3326ec7ed9f21fb6c68e628d8708a54f, ASSIGN in 412 msec 2023-07-24 13:06:17,233 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:06:17,234 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203977233"}]},"ts":"1690203977233"} 2023-07-24 13:06:17,241 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 13:06:17,247 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:06:17,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 539 msec 2023-07-24 13:06:17,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 13:06:17,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 13:06:17,387 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 13:06:18,476 WARN [Thread-384] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:18,871 INFO [Thread-384] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:18,879 INFO [Thread-384] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38511_jobhistory____.76epmv/webapp 2023-07-24 13:06:19,077 INFO [Thread-384] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 13:06:19,078 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 13:06:19,078 INFO [Thread-384] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 13:06:19,082 INFO [Thread-384] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 13:06:19,178 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:19,543 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:20,013 INFO [Thread-384] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 13:06:20,096 INFO [Thread-384] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38511 2023-07-24 13:06:21,122 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:06:21,364 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 13:06:21,366 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 13:06:21,366 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 13:06:21,466 WARN [Listener at jenkins-hbase4.apache.org/34167] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:21,554 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:21,554 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 13:06:21,555 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:21,555 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 13:06:21,555 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 13:06:21,555 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 13:06:21,556 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:21,556 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 13:06:21,556 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 13:06:21,556 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 13:06:21,574 WARN [Listener at jenkins-hbase4.apache.org/34167] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 13:06:21,575 INFO [Listener at jenkins-hbase4.apache.org/34167] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:21,583 INFO [Listener at jenkins-hbase4.apache.org/34167] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38283_cluster____.ggcr5w/webapp 2023-07-24 13:06:21,692 INFO [Listener at jenkins-hbase4.apache.org/34167] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 13:06:21,692 INFO [Listener at jenkins-hbase4.apache.org/34167] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 13:06:21,692 INFO [Listener at jenkins-hbase4.apache.org/34167] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 13:06:21,693 INFO [Listener at jenkins-hbase4.apache.org/34167] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 13:06:21,704 INFO [Listener at jenkins-hbase4.apache.org/34167] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:21,913 INFO [Listener at jenkins-hbase4.apache.org/34167] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:22,024 INFO [Listener at jenkins-hbase4.apache.org/34167] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:22,031 INFO [Listener at jenkins-hbase4.apache.org/34167] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38283 2023-07-24 13:06:22,602 WARN [Listener at jenkins-hbase4.apache.org/33061] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:22,629 WARN [Listener at jenkins-hbase4.apache.org/33061] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 13:06:22,629 INFO [Listener at jenkins-hbase4.apache.org/33061] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:22,637 INFO [Listener at jenkins-hbase4.apache.org/33061] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_40125_node____38a7au/webapp 2023-07-24 13:06:22,707 INFO [Listener at jenkins-hbase4.apache.org/33061] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 13:06:22,707 INFO [Listener at jenkins-hbase4.apache.org/33061] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 13:06:22,708 INFO [Listener at jenkins-hbase4.apache.org/33061] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 13:06:22,708 INFO [Listener at jenkins-hbase4.apache.org/33061] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 13:06:22,719 INFO [Listener at jenkins-hbase4.apache.org/33061] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:22,744 INFO [Listener at jenkins-hbase4.apache.org/33061] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:22,844 INFO [Listener at jenkins-hbase4.apache.org/33061] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:22,863 INFO [Listener at jenkins-hbase4.apache.org/33061] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:40125 2023-07-24 13:06:23,218 WARN [Listener at jenkins-hbase4.apache.org/43547] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 13:06:23,226 WARN [Listener at jenkins-hbase4.apache.org/43547] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 13:06:23,226 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 13:06:23,238 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_41603_node____.5wtleu/webapp 2023-07-24 13:06:23,296 INFO [Listener at jenkins-hbase4.apache.org/43547] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 13:06:23,296 INFO [Listener at jenkins-hbase4.apache.org/43547] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 13:06:23,297 INFO [Listener at jenkins-hbase4.apache.org/43547] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 13:06:23,297 INFO [Listener at jenkins-hbase4.apache.org/43547] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 13:06:23,306 INFO [Listener at jenkins-hbase4.apache.org/43547] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:23,324 INFO [Listener at jenkins-hbase4.apache.org/43547] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:23,429 INFO [Listener at jenkins-hbase4.apache.org/43547] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 13:06:23,456 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:41603 2023-07-24 13:06:23,497 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 13:06:23,499 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:23,587 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=708, OpenFileDescriptor=901, MaxFileDescriptor=60000, SystemLoadAverage=160, ProcessCount=172, AvailableMemoryMB=7773 2023-07-24 13:06:23,587 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=708 is superior to 500 2023-07-24 13:06:23,604 DEBUG [Listener at jenkins-hbase4.apache.org/43547] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 13:06:23,612 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35028, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 13:06:23,621 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:23,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:23,626 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:06:23,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 13:06:23,629 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:06:23,630 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 13:06:23,635 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:23,635 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:23,637 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc empty. 2023-07-24 13:06:23,638 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b empty. 2023-07-24 13:06:23,638 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:23,640 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:23,640 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 13:06:23,680 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:23,684 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => f7595c5b523203c7f2120a33bdb8abdc, NAME => 'testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:06:23,693 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => 571efcddf35c013dcb3106be015cd30b, NAME => 'testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:06:23,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 13:06:23,743 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:23,745 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing 571efcddf35c013dcb3106be015cd30b, disabling compactions & flushes 2023-07-24 13:06:23,745 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:23,745 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:23,745 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. after waiting 0 ms 2023-07-24 13:06:23,745 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:23,745 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:23,745 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for 571efcddf35c013dcb3106be015cd30b: 2023-07-24 13:06:23,751 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:23,751 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing f7595c5b523203c7f2120a33bdb8abdc, disabling compactions & flushes 2023-07-24 13:06:23,751 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:23,751 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:23,751 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. after waiting 0 ms 2023-07-24 13:06:23,751 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:23,751 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:23,751 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for f7595c5b523203c7f2120a33bdb8abdc: 2023-07-24 13:06:23,758 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:06:23,761 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203983759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690203983759"}]},"ts":"1690203983759"} 2023-07-24 13:06:23,761 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203983759"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690203983759"}]},"ts":"1690203983759"} 2023-07-24 13:06:23,816 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:06:23,817 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:06:23,817 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203983817"}]},"ts":"1690203983817"} 2023-07-24 13:06:23,820 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 13:06:23,824 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:23,826 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:23,826 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:23,826 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:23,826 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:23,827 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f7595c5b523203c7f2120a33bdb8abdc, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=571efcddf35c013dcb3106be015cd30b, ASSIGN}] 2023-07-24 13:06:23,830 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=571efcddf35c013dcb3106be015cd30b, ASSIGN 2023-07-24 13:06:23,830 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f7595c5b523203c7f2120a33bdb8abdc, ASSIGN 2023-07-24 13:06:23,831 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=571efcddf35c013dcb3106be015cd30b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36483,1690203972884; forceNewPlan=false, retain=false 2023-07-24 13:06:23,831 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f7595c5b523203c7f2120a33bdb8abdc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36751,1690203972794; forceNewPlan=false, retain=false 2023-07-24 13:06:23,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 13:06:23,982 INFO [jenkins-hbase4:42065] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:06:23,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f7595c5b523203c7f2120a33bdb8abdc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:23,984 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=571efcddf35c013dcb3106be015cd30b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:23,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203983984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690203983984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690203983984"}]},"ts":"1690203983984"} 2023-07-24 13:06:23,984 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203983984"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690203983984"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690203983984"}]},"ts":"1690203983984"} 2023-07-24 13:06:23,987 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=13, state=RUNNABLE; OpenRegionProcedure f7595c5b523203c7f2120a33bdb8abdc, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:06:23,988 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=14, state=RUNNABLE; OpenRegionProcedure 571efcddf35c013dcb3106be015cd30b, server=jenkins-hbase4.apache.org,36483,1690203972884}] 2023-07-24 13:06:24,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:24,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f7595c5b523203c7f2120a33bdb8abdc, NAME => 'testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:06:24,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:24,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. service=AccessControlService 2023-07-24 13:06:24,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 571efcddf35c013dcb3106be015cd30b, NAME => 'testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:06:24,146 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. service=AccessControlService 2023-07-24 13:06:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:24,147 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:24,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:24,149 INFO [StoreOpener-f7595c5b523203c7f2120a33bdb8abdc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:24,149 INFO [StoreOpener-571efcddf35c013dcb3106be015cd30b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:24,151 DEBUG [StoreOpener-f7595c5b523203c7f2120a33bdb8abdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/cf 2023-07-24 13:06:24,151 DEBUG [StoreOpener-f7595c5b523203c7f2120a33bdb8abdc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/cf 2023-07-24 13:06:24,151 DEBUG [StoreOpener-571efcddf35c013dcb3106be015cd30b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/cf 2023-07-24 13:06:24,151 DEBUG [StoreOpener-571efcddf35c013dcb3106be015cd30b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/cf 2023-07-24 13:06:24,151 INFO [StoreOpener-571efcddf35c013dcb3106be015cd30b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 571efcddf35c013dcb3106be015cd30b columnFamilyName cf 2023-07-24 13:06:24,151 INFO [StoreOpener-f7595c5b523203c7f2120a33bdb8abdc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f7595c5b523203c7f2120a33bdb8abdc columnFamilyName cf 2023-07-24 13:06:24,152 INFO [StoreOpener-571efcddf35c013dcb3106be015cd30b-1] regionserver.HStore(310): Store=571efcddf35c013dcb3106be015cd30b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:24,154 INFO [StoreOpener-f7595c5b523203c7f2120a33bdb8abdc-1] regionserver.HStore(310): Store=f7595c5b523203c7f2120a33bdb8abdc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:24,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:24,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:24,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:24,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:24,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:24,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:24,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:24,168 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:24,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 571efcddf35c013dcb3106be015cd30b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70930290, jitterRate=0.056943684816360474}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:24,168 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f7595c5b523203c7f2120a33bdb8abdc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65813047, jitterRate=-0.01930917799472809}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:24,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 571efcddf35c013dcb3106be015cd30b: 2023-07-24 13:06:24,169 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f7595c5b523203c7f2120a33bdb8abdc: 2023-07-24 13:06:24,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b., pid=16, masterSystemTime=1690203984142 2023-07-24 13:06:24,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc., pid=15, masterSystemTime=1690203984140 2023-07-24 13:06:24,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:24,172 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:24,173 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=571efcddf35c013dcb3106be015cd30b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:24,174 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:24,174 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203984173"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690203984173"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690203984173"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690203984173"}]},"ts":"1690203984173"} 2023-07-24 13:06:24,174 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:24,175 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f7595c5b523203c7f2120a33bdb8abdc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:24,176 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690203984175"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690203984175"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690203984175"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690203984175"}]},"ts":"1690203984175"} 2023-07-24 13:06:24,184 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=14 2023-07-24 13:06:24,185 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=14, state=SUCCESS; OpenRegionProcedure 571efcddf35c013dcb3106be015cd30b, server=jenkins-hbase4.apache.org,36483,1690203972884 in 189 msec 2023-07-24 13:06:24,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=13 2023-07-24 13:06:24,190 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=571efcddf35c013dcb3106be015cd30b, ASSIGN in 358 msec 2023-07-24 13:06:24,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=13, state=SUCCESS; OpenRegionProcedure f7595c5b523203c7f2120a33bdb8abdc, server=jenkins-hbase4.apache.org,36751,1690203972794 in 193 msec 2023-07-24 13:06:24,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-24 13:06:24,200 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f7595c5b523203c7f2120a33bdb8abdc, ASSIGN in 363 msec 2023-07-24 13:06:24,201 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:06:24,202 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690203984201"}]},"ts":"1690203984201"} 2023-07-24 13:06:24,216 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 13:06:24,221 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:06:24,228 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 13:06:24,235 DEBUG [PEWorker-3] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:24,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 13:06:24,249 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:24,255 DEBUG [hconnection-0x51411f79-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:24,259 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47198, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2023-07-24 13:06:24,270 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 13:06:24,306 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:24,306 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:24,306 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:24,306 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:24,306 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:06:24,319 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:24,319 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:24,319 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:24,320 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:24,323 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:24,323 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:24,325 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:24,325 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 699 msec 2023-07-24 13:06:24,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 13:06:24,751 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 13:06:24,751 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportWithTargetName get assigned. Timeout = 60000ms 2023-07-24 13:06:24,752 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:24,757 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportWithTargetName assigned to meta. Checking AM states. 2023-07-24 13:06:24,758 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:24,758 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportWithTargetName assigned. 2023-07-24 13:06:24,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:24,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690203984774 (current time:1690203984774). 2023-07-24 13:06:24,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:06:24,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x0e7b3545 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:24,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@133aca33, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:24,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:24,785 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47204, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:24,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0e7b3545 to 127.0.0.1:59137 2023-07-24 13:06:24,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:24,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x083e2003 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:24,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b6f2ff9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:24,795 DEBUG [hconnection-0x772bc3d1-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:24,796 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47216, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:24,800 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:24,801 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36818, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:24,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x083e2003 to 127.0.0.1:59137 2023-07-24 13:06:24,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:24,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 13:06:24,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:06:24,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:24,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:24,857 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:24,860 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690204584860 2023-07-24 13:06:24,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:24,861 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 13:06:24,867 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:24,867 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:24,869 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:06:24,870 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:06:24,870 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 21 msec 2023-07-24 13:06:24,872 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:24,873 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690204584873 2023-07-24 13:06:24,920 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,927 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 13:06:24,927 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:24,928 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 13:06:24,928 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 13:06:24,929 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,929 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,934 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:24,934 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:24,934 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:24,934 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:24,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:24,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:24,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:24,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:24,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:24,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:24,935 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:24,935 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:24,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,935 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:24,935 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:06:24,935 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 13:06:24,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,936 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 13:06:24,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,937 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:24,937 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:24,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 13:06:24,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,937 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:24,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,939 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,943 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:24,943 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:24,943 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:24,943 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:24,943 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:24,944 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:24,946 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:24,946 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:24,943 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:24,946 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:24,946 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:24,947 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:24,947 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:24,947 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:24,947 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:24,949 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:24,949 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,950 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:24,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:24,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:24,950 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,951 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:24,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:24,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:24,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:24,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:24,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:24,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:24,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 13:06:24,955 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e66fb91[Count = 1] remaining members to acquire global barrier 2023-07-24 13:06:24,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:24,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:24,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:24,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:24,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:24,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:24,962 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:24,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:24,963 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:24,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 13:06:24,963 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2e66fb91[Count = 0] remaining members to acquire global barrier 2023-07-24 13:06:24,963 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 13:06:24,964 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,966 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,966 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,966 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,966 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:24,967 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:24,966 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:24,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,967 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:24,967 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:24,967 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:06:24,967 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:24,967 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:06:24,968 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:24,968 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:24,968 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:24,968 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:24,968 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:24,968 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:24,968 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. started... 2023-07-24 13:06:24,968 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. started... 2023-07-24 13:06:24,970 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:24,971 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:24,971 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:24,971 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:24,973 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 571efcddf35c013dcb3106be015cd30b: 2023-07-24 13:06:24,973 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f7595c5b523203c7f2120a33bdb8abdc: 2023-07-24 13:06:24,974 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,974 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:24,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:24,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:24,977 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:06:24,980 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:24,980 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:24,984 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:06:24,984 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:06:25,035 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. completed. 2023-07-24 13:06:25,035 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:25,036 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:25,036 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:25,036 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,036 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:25,036 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:06:25,036 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. completed. 2023-07-24 13:06:25,036 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:25,037 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:25,037 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:25,037 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,037 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:25,037 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:06:25,038 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,038 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,038 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,038 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:25,040 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:25,040 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,040 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:25,042 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36751,1690203972794': 2023-07-24 13:06:25,049 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 13:06:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36483,1690203972884': 2023-07-24 13:06:25,053 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 13:06:25,053 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 13:06:25,054 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:06:25,054 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:06:25,054 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,054 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:06:25,057 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,057 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,057 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,057 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,057 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,057 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,057 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,058 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,058 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,058 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,059 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,059 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,061 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,064 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,064 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,065 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,083 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,083 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,083 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,083 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,083 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,083 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,083 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,084 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,084 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,084 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,084 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,085 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,087 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,146 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,178 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:25,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:25,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:25,184 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:06:25,202 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 13:06:25,203 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,203 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:25,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690203984861Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690203985084 (+223 ms)Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690203985085 (+1 ms)Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690203985099 (+14 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690203985132 (+33 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690203985202 (+70 ms) 2023-07-24 13:06:25,206 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:25,208 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 342 msec 2023-07-24 13:06:25,484 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:25,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:25,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:06:25,506 DEBUG [htable-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:25,506 DEBUG [htable-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:25,512 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47362, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:25,512 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36820, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:25,512 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36751] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:06:25,514 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36483] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:06:25,520 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 13:06:25,521 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:25,523 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:25,556 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:25,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690203985556 (current time:1690203985556). 2023-07-24 13:06:25,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:06:25,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x1c7f4f38 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:25,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@770da2ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:25,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:25,566 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:25,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1c7f4f38 to 127.0.0.1:59137 2023-07-24 13:06:25,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:25,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x74c63eff to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:25,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@12a6a9d0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:25,577 DEBUG [hconnection-0x82663aa-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:25,580 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:25,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:25,589 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36828, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:25,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74c63eff to 127.0.0.1:59137 2023-07-24 13:06:25,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:25,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 13:06:25,592 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:06:25,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:25,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:25,597 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:25,598 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690204585598 2023-07-24 13:06:25,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 13:06:25,598 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 13:06:25,600 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:06:25,600 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:06:25,601 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 13:06:25,601 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:25,603 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 7 msec 2023-07-24 13:06:25,604 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:25,604 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690204585604 2023-07-24 13:06:25,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 13:06:25,623 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 13:06:25,623 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,624 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 13:06:25,624 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 13:06:25,624 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,625 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,626 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,626 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,626 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,626 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,626 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,626 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,626 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,627 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,627 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,627 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,627 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:06:25,627 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,627 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,628 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 13:06:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 13:06:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,628 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:25,628 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 13:06:25,628 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,629 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 13:06:25,630 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 13:06:25,631 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:25,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 13:06:25,631 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,631 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:25,631 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,634 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 13:06:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 13:06:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:25,637 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 13:06:25,637 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:25,636 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:25,637 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:25,637 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:25,637 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 13:06:25,637 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 13:06:25,640 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,640 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,642 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,642 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,642 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,642 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,642 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:25,642 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,643 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,643 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,643 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:25,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 13:06:25,645 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b7e54b[Count = 1] remaining members to acquire global barrier 2023-07-24 13:06:25,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,645 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 13:06:25,649 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b7e54b[Count = 0] remaining members to acquire global barrier 2023-07-24 13:06:25,649 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 13:06:25,649 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,653 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,653 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,653 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,653 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,654 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,653 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:25,654 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 13:06:25,654 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:06:25,654 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. started... 2023-07-24 13:06:25,654 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:25,654 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. started... 2023-07-24 13:06:25,654 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,655 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:06:25,655 INFO [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 571efcddf35c013dcb3106be015cd30b 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 13:06:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:25,655 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2745): Flushing f7595c5b523203c7f2120a33bdb8abdc 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 13:06:25,654 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:25,655 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:25,658 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:25,658 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,658 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:25,700 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:25,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:25,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:25,702 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:06:25,769 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=132 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/.tmp/cf/acf0cda292b64db2ab7ada4f17321ba4 2023-07-24 13:06:25,795 INFO [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.13 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/.tmp/cf/e1db6008755d46078bd4903232df7eff 2023-07-24 13:06:25,849 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/.tmp/cf/acf0cda292b64db2ab7ada4f17321ba4 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/cf/acf0cda292b64db2ab7ada4f17321ba4 2023-07-24 13:06:25,854 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/.tmp/cf/e1db6008755d46078bd4903232df7eff as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/cf/e1db6008755d46078bd4903232df7eff 2023-07-24 13:06:25,859 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/cf/acf0cda292b64db2ab7ada4f17321ba4, entries=2, sequenceid=6, filesize=5.0 K 2023-07-24 13:06:25,864 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for f7595c5b523203c7f2120a33bdb8abdc in 209ms, sequenceid=6, compaction requested=false 2023-07-24 13:06:25,864 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 13:06:25,865 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for f7595c5b523203c7f2120a33bdb8abdc: 2023-07-24 13:06:25,865 INFO [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/cf/e1db6008755d46078bd4903232df7eff, entries=48, sequenceid=6, filesize=8.1 K 2023-07-24 13:06:25,870 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 13:06:25,871 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:25,872 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/cf/acf0cda292b64db2ab7ada4f17321ba4] hfiles 2023-07-24 13:06:25,873 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/cf/acf0cda292b64db2ab7ada4f17321ba4 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 13:06:25,873 INFO [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 571efcddf35c013dcb3106be015cd30b in 219ms, sequenceid=6, compaction requested=false 2023-07-24 13:06:25,874 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 571efcddf35c013dcb3106be015cd30b: 2023-07-24 13:06:25,875 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 13:06:25,875 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:25,875 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/cf/e1db6008755d46078bd4903232df7eff] hfiles 2023-07-24 13:06:25,875 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/cf/e1db6008755d46078bd4903232df7eff for snapshot=snaptb0-testExportWithTargetName 2023-07-24 13:06:25,903 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:25,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:25,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:25,913 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:06:25,916 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. completed. 2023-07-24 13:06:25,916 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. completed. 2023-07-24 13:06:25,916 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:25,916 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:25,916 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:25,916 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:06:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 13:06:25,917 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:06:25,920 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,920 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,920 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,920 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:25,921 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,921 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 13:06:25,922 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,922 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 13:06:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36751,1690203972794': 2023-07-24 13:06:25,928 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 13:06:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,36483,1690203972884': 2023-07-24 13:06:25,932 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 13:06:25,932 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 13:06:25,932 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:06:25,932 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:06:25,932 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 13:06:25,932 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:06:25,934 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,934 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:25,934 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,934 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,934 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,934 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:25,935 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,935 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,935 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,935 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,935 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,935 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,936 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:25,936 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:25,939 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 13:06:25,939 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,939 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,940 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,952 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,953 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,953 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,953 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,953 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,953 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,953 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,953 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:25,953 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,953 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:25,953 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,953 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 13:06:25,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:25,955 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 13:06:25,955 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,954 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:25,955 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,955 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,955 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:25,955 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:25,955 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:25,955 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,955 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,956 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 13:06:25,956 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:25,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:25,997 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,049 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 13:06:26,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,049 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 13:06:26,049 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690203985598Consolidate snapshot: snaptb0-testExportWithTargetName at 1690203985955 (+357 ms)Loading Region manifests for snaptb0-testExportWithTargetName at 1690203985955Writing data manifest for snaptb0-testExportWithTargetName at 1690203985964 (+9 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690203985983 (+19 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690203986049 (+66 ms) 2023-07-24 13:06:26,051 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 13:06:26,054 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 451 msec 2023-07-24 13:06:26,213 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:26,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 13:06:26,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:06:26,217 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690203986217 2023-07-24 13:06:26,217 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35185, tgtDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690203986217, rawTgtDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690203986217, srcFsUri=hdfs://localhost:35185, srcDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:06:26,264 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:06:26,264 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1467276448_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690203986217, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690203986217/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 13:06:26,264 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83, snapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 13:06:26,280 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690203986217/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 13:06:26,391 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:26,392 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:26,392 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:26,393 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,443 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-8681055732582222709.jar 2023-07-24 13:06:27,444 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,444 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,525 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-2399097732533829416.jar 2023-07-24 13:06:27,526 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,526 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,527 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,527 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,528 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,528 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:27,528 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:06:27,529 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:06:27,529 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:06:27,530 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:06:27,530 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:06:27,531 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:06:27,531 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:06:27,532 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:06:27,532 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:06:27,532 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:06:27,536 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:27,537 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:27,537 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:27,538 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:27,538 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:27,539 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:27,539 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:28,950 WARN [Listener at jenkins-hbase4.apache.org/43547] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:06:28,957 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 13:06:28,969 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 13:06:29,582 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:06:29,584 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:06:29,667 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:06:30,214 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0001_000001 (auth:SIMPLE) 2023-07-24 13:06:35,502 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0001_000001 (auth:SIMPLE) 2023-07-24 13:06:37,803 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0001_000001 (auth:SIMPLE) 2023-07-24 13:06:40,820 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0001_000001 (auth:SIMPLE) 2023-07-24 13:06:42,050 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:06:42,053 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:06:42,063 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 13:06:42,063 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:06:42,064 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:06:42,064 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 13:06:42,065 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 13:06:42,065 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 13:06:42,065 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690203986217/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690203986217/.hbase-snapshot/testExportWithTargetName 2023-07-24 13:06:42,066 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690203986217/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 13:06:42,066 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690203986217/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 13:06:42,078 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 13:06:42,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 13:06:42,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:42,099 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204002099"}]},"ts":"1690204002099"} 2023-07-24 13:06:42,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 13:06:42,101 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 13:06:42,103 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 13:06:42,104 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f7595c5b523203c7f2120a33bdb8abdc, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=571efcddf35c013dcb3106be015cd30b, UNASSIGN}] 2023-07-24 13:06:42,107 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f7595c5b523203c7f2120a33bdb8abdc, UNASSIGN 2023-07-24 13:06:42,107 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=571efcddf35c013dcb3106be015cd30b, UNASSIGN 2023-07-24 13:06:42,107 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f7595c5b523203c7f2120a33bdb8abdc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:42,108 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=571efcddf35c013dcb3106be015cd30b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:42,108 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690204002107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204002107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204002107"}]},"ts":"1690204002107"} 2023-07-24 13:06:42,108 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690204002108"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204002108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204002108"}]},"ts":"1690204002108"} 2023-07-24 13:06:42,110 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure f7595c5b523203c7f2120a33bdb8abdc, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:06:42,110 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure 571efcddf35c013dcb3106be015cd30b, server=jenkins-hbase4.apache.org,36483,1690203972884}] 2023-07-24 13:06:42,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 13:06:42,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:42,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:42,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 571efcddf35c013dcb3106be015cd30b, disabling compactions & flushes 2023-07-24 13:06:42,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f7595c5b523203c7f2120a33bdb8abdc, disabling compactions & flushes 2023-07-24 13:06:42,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:42,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:42,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:42,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:42,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. after waiting 0 ms 2023-07-24 13:06:42,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. after waiting 0 ms 2023-07-24 13:06:42,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:42,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:42,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:06:42,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:06:42,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:42,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:42,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc. 2023-07-24 13:06:42,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b. 2023-07-24 13:06:42,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f7595c5b523203c7f2120a33bdb8abdc: 2023-07-24 13:06:42,290 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 571efcddf35c013dcb3106be015cd30b: 2023-07-24 13:06:42,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:42,293 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=f7595c5b523203c7f2120a33bdb8abdc, regionState=CLOSED 2023-07-24 13:06:42,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:42,293 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690204002293"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204002293"}]},"ts":"1690204002293"} 2023-07-24 13:06:42,296 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=571efcddf35c013dcb3106be015cd30b, regionState=CLOSED 2023-07-24 13:06:42,296 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690204002296"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204002296"}]},"ts":"1690204002296"} 2023-07-24 13:06:42,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-24 13:06:42,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure f7595c5b523203c7f2120a33bdb8abdc, server=jenkins-hbase4.apache.org,36751,1690203972794 in 186 msec 2023-07-24 13:06:42,301 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=f7595c5b523203c7f2120a33bdb8abdc, UNASSIGN in 195 msec 2023-07-24 13:06:42,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-24 13:06:42,301 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure 571efcddf35c013dcb3106be015cd30b, server=jenkins-hbase4.apache.org,36483,1690203972884 in 188 msec 2023-07-24 13:06:42,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-24 13:06:42,304 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=571efcddf35c013dcb3106be015cd30b, UNASSIGN in 197 msec 2023-07-24 13:06:42,305 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204002305"}]},"ts":"1690204002305"} 2023-07-24 13:06:42,307 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 13:06:42,309 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 13:06:42,312 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 223 msec 2023-07-24 13:06:42,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 13:06:42,403 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 13:06:42,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 13:06:42,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:42,418 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:42,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 13:06:42,421 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:42,423 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 13:06:42,426 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:42,426 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:42,430 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/recovered.edits] 2023-07-24 13:06:42,430 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/recovered.edits] 2023-07-24 13:06:42,432 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:42,432 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:42,432 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:42,432 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:42,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 13:06:42,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 13:06:42,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 13:06:42,433 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF 2023-07-24 13:06:42,434 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:42,434 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:42,434 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:42,434 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:42,434 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:42,434 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:42,434 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 13:06:42,434 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:42,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 13:06:42,439 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/cf/acf0cda292b64db2ab7ada4f17321ba4 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/cf/acf0cda292b64db2ab7ada4f17321ba4 2023-07-24 13:06:42,439 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/cf/e1db6008755d46078bd4903232df7eff to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/cf/e1db6008755d46078bd4903232df7eff 2023-07-24 13:06:42,444 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc/recovered.edits/9.seqid 2023-07-24 13:06:42,444 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b/recovered.edits/9.seqid 2023-07-24 13:06:42,445 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/f7595c5b523203c7f2120a33bdb8abdc 2023-07-24 13:06:42,445 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportWithTargetName/571efcddf35c013dcb3106be015cd30b 2023-07-24 13:06:42,445 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 13:06:42,448 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:42,472 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 13:06:42,475 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 13:06:42,477 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:42,477 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 13:06:42,477 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204002477"}]},"ts":"9223372036854775807"} 2023-07-24 13:06:42,477 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204002477"}]},"ts":"9223372036854775807"} 2023-07-24 13:06:42,480 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:06:42,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f7595c5b523203c7f2120a33bdb8abdc, NAME => 'testtb-testExportWithTargetName,,1690203983620.f7595c5b523203c7f2120a33bdb8abdc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 571efcddf35c013dcb3106be015cd30b, NAME => 'testtb-testExportWithTargetName,1,1690203983620.571efcddf35c013dcb3106be015cd30b.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:06:42,480 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 13:06:42,480 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204002480"}]},"ts":"9223372036854775807"} 2023-07-24 13:06:42,483 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 13:06:42,486 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 13:06:42,495 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 77 msec 2023-07-24 13:06:42,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 13:06:42,539 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 13:06:42,559 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 13:06:42,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 13:06:42,565 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 13:06:42,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 13:06:42,597 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportWithTargetName Thread=755 (was 708) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:57500 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-4-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:306) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:363) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1393857761_1 at /127.0.0.1:52092 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:36896 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:52124 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:36249 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1393857761_1 at /127.0.0.1:36862 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:33029 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1284 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=921 (was 901) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 160) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 172) - ProcessCount LEAK? -, AvailableMemoryMB=6136 (was 7773) 2023-07-24 13:06:42,597 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-24 13:06:42,617 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=755, OpenFileDescriptor=921, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=179, AvailableMemoryMB=6135 2023-07-24 13:06:42,617 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=755 is superior to 500 2023-07-24 13:06:42,619 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:42,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:06:42,623 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:06:42,623 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 13:06:42,624 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:06:42,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 13:06:42,627 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:42,627 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:42,628 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde empty. 2023-07-24 13:06:42,628 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2 empty. 2023-07-24 13:06:42,628 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:42,628 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:42,628 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 13:06:42,648 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:42,650 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => fbb2cf2e54c6f63a3fab5b42c7023cde, NAME => 'testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:06:42,650 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 6da6c7fd5275f62b8e1550e04a2b77b2, NAME => 'testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:06:42,677 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:42,677 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 6da6c7fd5275f62b8e1550e04a2b77b2, disabling compactions & flushes 2023-07-24 13:06:42,678 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:42,678 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:42,678 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:42,678 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. after waiting 0 ms 2023-07-24 13:06:42,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing fbb2cf2e54c6f63a3fab5b42c7023cde, disabling compactions & flushes 2023-07-24 13:06:42,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:42,679 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:42,679 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:42,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:42,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 6da6c7fd5275f62b8e1550e04a2b77b2: 2023-07-24 13:06:42,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. after waiting 0 ms 2023-07-24 13:06:42,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:42,679 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:42,679 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for fbb2cf2e54c6f63a3fab5b42c7023cde: 2023-07-24 13:06:42,682 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:06:42,683 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204002683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204002683"}]},"ts":"1690204002683"} 2023-07-24 13:06:42,683 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204002683"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204002683"}]},"ts":"1690204002683"} 2023-07-24 13:06:42,686 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:06:42,687 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:06:42,687 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204002687"}]},"ts":"1690204002687"} 2023-07-24 13:06:42,689 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 13:06:42,692 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:42,693 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:42,693 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:42,694 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:42,694 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:42,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fbb2cf2e54c6f63a3fab5b42c7023cde, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6da6c7fd5275f62b8e1550e04a2b77b2, ASSIGN}] 2023-07-24 13:06:42,696 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6da6c7fd5275f62b8e1550e04a2b77b2, ASSIGN 2023-07-24 13:06:42,696 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fbb2cf2e54c6f63a3fab5b42c7023cde, ASSIGN 2023-07-24 13:06:42,697 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fbb2cf2e54c6f63a3fab5b42c7023cde, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43049,1690203972978; forceNewPlan=false, retain=false 2023-07-24 13:06:42,697 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6da6c7fd5275f62b8e1550e04a2b77b2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36751,1690203972794; forceNewPlan=false, retain=false 2023-07-24 13:06:42,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 13:06:42,848 INFO [jenkins-hbase4:42065] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:06:42,850 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6da6c7fd5275f62b8e1550e04a2b77b2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:42,850 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fbb2cf2e54c6f63a3fab5b42c7023cde, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:42,851 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204002850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204002850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204002850"}]},"ts":"1690204002850"} 2023-07-24 13:06:42,851 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204002850"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204002850"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204002850"}]},"ts":"1690204002850"} 2023-07-24 13:06:42,853 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=29, state=RUNNABLE; OpenRegionProcedure 6da6c7fd5275f62b8e1550e04a2b77b2, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:06:42,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=28, state=RUNNABLE; OpenRegionProcedure fbb2cf2e54c6f63a3fab5b42c7023cde, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:06:42,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 13:06:43,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:43,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6da6c7fd5275f62b8e1550e04a2b77b2, NAME => 'testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:06:43,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. service=AccessControlService 2023-07-24 13:06:43,016 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:43,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:43,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:43,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:43,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:43,017 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:43,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fbb2cf2e54c6f63a3fab5b42c7023cde, NAME => 'testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:06:43,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. service=AccessControlService 2023-07-24 13:06:43,018 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:43,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:43,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:43,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:43,018 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:43,018 INFO [StoreOpener-6da6c7fd5275f62b8e1550e04a2b77b2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:43,020 INFO [StoreOpener-fbb2cf2e54c6f63a3fab5b42c7023cde-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:43,020 DEBUG [StoreOpener-6da6c7fd5275f62b8e1550e04a2b77b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/cf 2023-07-24 13:06:43,020 DEBUG [StoreOpener-6da6c7fd5275f62b8e1550e04a2b77b2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/cf 2023-07-24 13:06:43,021 INFO [StoreOpener-6da6c7fd5275f62b8e1550e04a2b77b2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6da6c7fd5275f62b8e1550e04a2b77b2 columnFamilyName cf 2023-07-24 13:06:43,021 DEBUG [StoreOpener-fbb2cf2e54c6f63a3fab5b42c7023cde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/cf 2023-07-24 13:06:43,021 DEBUG [StoreOpener-fbb2cf2e54c6f63a3fab5b42c7023cde-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/cf 2023-07-24 13:06:43,021 INFO [StoreOpener-6da6c7fd5275f62b8e1550e04a2b77b2-1] regionserver.HStore(310): Store=6da6c7fd5275f62b8e1550e04a2b77b2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:43,023 INFO [StoreOpener-fbb2cf2e54c6f63a3fab5b42c7023cde-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbb2cf2e54c6f63a3fab5b42c7023cde columnFamilyName cf 2023-07-24 13:06:43,024 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:43,024 INFO [StoreOpener-fbb2cf2e54c6f63a3fab5b42c7023cde-1] regionserver.HStore(310): Store=fbb2cf2e54c6f63a3fab5b42c7023cde/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:43,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:43,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:43,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:43,028 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:43,031 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:43,034 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:43,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:43,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6da6c7fd5275f62b8e1550e04a2b77b2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74275854, jitterRate=0.10679647326469421}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:43,035 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fbb2cf2e54c6f63a3fab5b42c7023cde; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73242771, jitterRate=0.0914023369550705}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:43,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6da6c7fd5275f62b8e1550e04a2b77b2: 2023-07-24 13:06:43,035 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fbb2cf2e54c6f63a3fab5b42c7023cde: 2023-07-24 13:06:43,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2., pid=30, masterSystemTime=1690204003005 2023-07-24 13:06:43,037 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde., pid=31, masterSystemTime=1690204003006 2023-07-24 13:06:43,038 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:43,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:43,039 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=6da6c7fd5275f62b8e1550e04a2b77b2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,039 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:43,039 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:43,039 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204003039"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204003039"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204003039"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204003039"}]},"ts":"1690204003039"} 2023-07-24 13:06:43,040 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=fbb2cf2e54c6f63a3fab5b42c7023cde, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,040 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204003040"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204003040"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204003040"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204003040"}]},"ts":"1690204003040"} 2023-07-24 13:06:43,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=29 2023-07-24 13:06:43,047 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=29, state=SUCCESS; OpenRegionProcedure 6da6c7fd5275f62b8e1550e04a2b77b2, server=jenkins-hbase4.apache.org,36751,1690203972794 in 188 msec 2023-07-24 13:06:43,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=28 2023-07-24 13:06:43,050 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=28, state=SUCCESS; OpenRegionProcedure fbb2cf2e54c6f63a3fab5b42c7023cde, server=jenkins-hbase4.apache.org,43049,1690203972978 in 188 msec 2023-07-24 13:06:43,050 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6da6c7fd5275f62b8e1550e04a2b77b2, ASSIGN in 353 msec 2023-07-24 13:06:43,052 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-24 13:06:43,052 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fbb2cf2e54c6f63a3fab5b42c7023cde, ASSIGN in 354 msec 2023-07-24 13:06:43,053 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:06:43,053 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204003053"}]},"ts":"1690204003053"} 2023-07-24 13:06:43,055 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 13:06:43,059 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:06:43,059 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 13:06:43,062 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:06:43,063 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:43,063 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:43,063 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:43,063 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:43,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:43,065 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:43,066 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:43,068 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 445 msec 2023-07-24 13:06:43,070 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:43,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 13:06:43,229 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 13:06:43,229 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemState get assigned. Timeout = 60000ms 2023-07-24 13:06:43,229 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:43,233 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemState assigned to meta. Checking AM states. 2023-07-24 13:06:43,234 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:43,234 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemState assigned. 2023-07-24 13:06:43,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:43,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204003237 (current time:1690204003237). 2023-07-24 13:06:43,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:06:43,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x37f49c07 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:43,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@794ab05d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:43,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:43,248 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:43,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37f49c07 to 127.0.0.1:59137 2023-07-24 13:06:43,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:43,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x5c8fcc5b to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:43,255 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4f887769, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:43,256 DEBUG [hconnection-0x63ecee9d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:43,259 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39578, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:43,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:43,263 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:43,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5c8fcc5b to 127.0.0.1:59137 2023-07-24 13:06:43,264 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:43,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:06:43,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:06:43,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:43,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:43,269 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:43,270 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690204603270 2023-07-24 13:06:43,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:43,271 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 13:06:43,272 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:06:43,272 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:06:43,273 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:43,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:43,275 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 13:06:43,276 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:43,277 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690204603277 2023-07-24 13:06:43,298 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,298 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 13:06:43,298 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:43,300 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 13:06:43,300 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 13:06:43,301 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,301 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,303 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,303 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,303 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,303 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,303 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,304 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,304 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,304 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,304 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,305 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,305 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:43,305 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:43,306 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:43,306 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:43,307 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:43,307 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:43,307 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:43,307 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:43,308 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,308 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:43,309 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:43,309 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:43,309 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:43,309 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:43,309 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:43,309 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:43,311 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,319 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:43,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,319 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,319 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:43,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:43,320 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,320 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:43,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:43,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:43,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 13:06:43,322 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dbac997[Count = 1] remaining members to acquire global barrier 2023-07-24 13:06:43,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:43,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:43,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:43,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:43,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:43,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 13:06:43,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4dbac997[Count = 0] remaining members to acquire global barrier 2023-07-24 13:06:43,326 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 13:06:43,326 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,329 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,329 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,329 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,329 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:43,329 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,329 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:43,330 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:43,330 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:43,330 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:43,330 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:43,330 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:43,330 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,330 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:06:43,330 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:43,330 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:43,330 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:06:43,330 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:43,330 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. started... 2023-07-24 13:06:43,330 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. started... 2023-07-24 13:06:43,332 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fbb2cf2e54c6f63a3fab5b42c7023cde: 2023-07-24 13:06:43,332 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6da6c7fd5275f62b8e1550e04a2b77b2: 2023-07-24 13:06:43,333 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,333 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,333 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:43,333 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:43,333 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:06:43,333 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:06:43,333 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:43,333 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:43,333 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:43,371 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. completed. 2023-07-24 13:06:43,371 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:43,371 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:43,371 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:43,372 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,372 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:43,372 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:06:43,372 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:43,373 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:43,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:06:43,373 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:43,373 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,374 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:43,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:43,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:43,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:43,376 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:06:43,377 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. completed. 2023-07-24 13:06:43,377 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:43,377 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:43,377 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:43,377 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:43,377 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:43,377 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:06:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:43,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,379 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,379 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,379 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:43,379 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:43,379 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,381 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,382 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,383 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:06:43,384 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 13:06:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:43,384 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:43,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,385 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:43,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36751,1690203972794': 2023-07-24 13:06:43,388 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 13:06:43,388 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 13:06:43,388 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:06:43,388 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:06:43,388 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,388 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:06:43,391 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,391 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,391 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,391 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,391 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,391 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,391 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:43,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:43,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,392 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:43,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,393 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,394 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,397 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:43,397 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,397 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,401 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,401 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,401 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,401 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,401 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,401 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,401 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,402 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,402 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,402 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,401 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,402 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,402 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,402 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,402 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,402 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:43,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,402 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,425 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,448 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 13:06:43,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,449 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:43,449 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690204003271Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690204003402 (+131 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690204003402Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690204003408 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690204003418 (+10 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690204003448 (+30 ms) 2023-07-24 13:06:43,452 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:43,454 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 180 msec 2023-07-24 13:06:43,577 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:43,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:06:43,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:06:43,588 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:06:43,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36751] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:06:43,595 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 13:06:43,595 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:43,596 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:43,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:43,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204003610 (current time:1690204003610). 2023-07-24 13:06:43,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:06:43,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x175cb553 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:43,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c908890, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:43,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:43,623 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:43,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x175cb553 to 127.0.0.1:59137 2023-07-24 13:06:43,624 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:43,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x58a6913b to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:43,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2de889d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:43,639 DEBUG [hconnection-0x183c2b7-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:43,640 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39594, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:43,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:43,649 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42598, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:43,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x58a6913b to 127.0.0.1:59137 2023-07-24 13:06:43,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:43,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:06:43,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:06:43,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:43,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:43,657 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:43,658 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690204603658 2023-07-24 13:06:43,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:06:43,658 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 13:06:43,659 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:06:43,660 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:06:43,661 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:06:43,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:43,663 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-24 13:06:43,664 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:43,665 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690204603665 2023-07-24 13:06:43,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 13:06:43,680 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 13:06:43,680 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:43,684 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 13:06:43,684 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 13:06:43,685 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,685 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,686 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,686 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,686 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,686 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,687 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,687 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,687 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,688 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,688 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:06:43,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 13:06:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 13:06:43,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,688 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:43,688 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:43,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 13:06:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 13:06:43,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:43,689 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 13:06:43,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 13:06:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:43,689 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 13:06:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 13:06:43,689 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:43,691 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:43,691 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:43,692 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:43,691 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 13:06:43,692 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:43,692 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:43,691 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 13:06:43,692 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:43,692 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 13:06:43,694 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,694 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,694 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:43,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:43,694 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,695 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,695 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,695 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:43,695 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:43,695 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:43,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:43,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 13:06:43,697 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@769cf0d6[Count = 1] remaining members to acquire global barrier 2023-07-24 13:06:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:43,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:43,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:43,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 13:06:43,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@769cf0d6[Count = 0] remaining members to acquire global barrier 2023-07-24 13:06:43,700 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 13:06:43,700 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,701 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,701 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,701 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,702 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:43,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,702 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,702 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:43,702 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:43,702 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:43,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,702 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:43,702 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:43,702 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. started... 2023-07-24 13:06:43,702 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,702 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:06:43,702 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:06:43,702 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:06:43,702 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2745): Flushing fbb2cf2e54c6f63a3fab5b42c7023cde 1/1 column families, dataSize=400 B heapSize=1.09 KB 2023-07-24 13:06:43,703 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:43,703 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:43,703 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:43,703 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. started... 2023-07-24 13:06:43,703 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6da6c7fd5275f62b8e1550e04a2b77b2 1/1 column families, dataSize=2.87 KB heapSize=6.44 KB 2023-07-24 13:06:43,704 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:43,704 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:43,704 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:43,728 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=400 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/.tmp/cf/d1fec2409f8a45579e1d63874596063e 2023-07-24 13:06:43,732 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.87 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/.tmp/cf/ff293dabe5df43319b1421f0a25d0162 2023-07-24 13:06:43,738 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/.tmp/cf/d1fec2409f8a45579e1d63874596063e as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/cf/d1fec2409f8a45579e1d63874596063e 2023-07-24 13:06:43,743 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/.tmp/cf/ff293dabe5df43319b1421f0a25d0162 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/cf/ff293dabe5df43319b1421f0a25d0162 2023-07-24 13:06:43,747 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/cf/d1fec2409f8a45579e1d63874596063e, entries=6, sequenceid=6, filesize=5.2 K 2023-07-24 13:06:43,751 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~400 B/400, heapSize ~1.08 KB/1104, currentSize=0 B/0 for fbb2cf2e54c6f63a3fab5b42c7023cde in 49ms, sequenceid=6, compaction requested=false 2023-07-24 13:06:43,751 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 13:06:43,752 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for fbb2cf2e54c6f63a3fab5b42c7023cde: 2023-07-24 13:06:43,752 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 13:06:43,752 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:43,752 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/cf/d1fec2409f8a45579e1d63874596063e] hfiles 2023-07-24 13:06:43,752 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/cf/d1fec2409f8a45579e1d63874596063e for snapshot=snaptb0-testExportFileSystemState 2023-07-24 13:06:43,758 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/cf/ff293dabe5df43319b1421f0a25d0162, entries=44, sequenceid=6, filesize=7.8 K 2023-07-24 13:06:43,760 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:43,761 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.87 KB/2936, heapSize ~6.42 KB/6576, currentSize=0 B/0 for 6da6c7fd5275f62b8e1550e04a2b77b2 in 58ms, sequenceid=6, compaction requested=false 2023-07-24 13:06:43,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:06:43,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:06:43,761 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:06:43,766 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6da6c7fd5275f62b8e1550e04a2b77b2: 2023-07-24 13:06:43,766 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 13:06:43,766 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:43,766 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/cf/ff293dabe5df43319b1421f0a25d0162] hfiles 2023-07-24 13:06:43,767 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/cf/ff293dabe5df43319b1421f0a25d0162 for snapshot=snaptb0-testExportFileSystemState 2023-07-24 13:06:43,780 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. completed. 2023-07-24 13:06:43,780 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:43,780 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:43,780 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:43,780 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,780 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:43,780 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:06:43,787 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:43,787 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,787 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:43,787 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:43,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:43,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,799 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:06:43,799 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 13:06:43,808 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. completed. 2023-07-24 13:06:43,808 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:43,808 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:43,808 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:43,808 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,808 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 13:06:43,808 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:06:43,810 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,810 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 13:06:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:43,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:43,810 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:43,810 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 13:06:43,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:43,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:43,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:43,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,814 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:43,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,36751,1690203972794': 2023-07-24 13:06:43,817 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 13:06:43,817 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 13:06:43,817 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:06:43,817 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:06:43,817 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 13:06:43,817 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:06:43,819 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,819 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,819 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,819 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,819 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:43,819 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,819 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,820 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:43,821 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:43,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,822 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:43,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,824 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:43,824 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 13:06:43,825 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,826 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,831 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:43,831 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,831 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:43,831 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:43,831 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:06:43,831 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 13:06:43,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,833 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,833 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:43,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:43,833 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,833 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,833 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:06:43,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:06:43,834 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,854 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,876 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 13:06:43,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,876 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,876 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690204003658Consolidate snapshot: snaptb0-testExportFileSystemState at 1690204003831 (+173 ms)Loading Region manifests for snaptb0-testExportFileSystemState at 1690204003833 (+2 ms)Writing data manifest for snaptb0-testExportFileSystemState at 1690204003838 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690204003846 (+8 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690204003876 (+30 ms) 2023-07-24 13:06:43,879 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 13:06:43,881 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 220 msec 2023-07-24 13:06:43,962 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:06:43,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:06:43,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:06:43,965 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204003965 2023-07-24 13:06:43,965 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35185, tgtDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204003965, rawTgtDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204003965, srcFsUri=hdfs://localhost:35185, srcDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:06:43,990 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:06:43,990 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-36000940_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204003965, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204003965/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 13:06:43,990 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83, snapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 13:06:44,006 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204003965/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 13:06:44,038 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:44,039 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:44,039 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:44,039 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,031 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-6835899505204697071.jar 2023-07-24 13:06:45,031 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,032 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,104 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-2609279214377265586.jar 2023-07-24 13:06:45,105 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,106 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,106 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,107 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,107 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,108 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:06:45,109 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:06:45,109 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:06:45,110 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:06:45,111 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:06:45,111 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:06:45,112 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:06:45,113 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:06:45,113 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:06:45,113 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:06:45,114 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:06:45,115 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:45,115 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:45,116 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:45,117 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:45,117 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:06:45,118 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:45,119 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:06:46,508 WARN [Listener at jenkins-hbase4.apache.org/43547] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:06:46,511 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 13:06:46,513 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 13:06:47,029 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:06:47,029 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:06:47,035 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0001_000001 (auth:SIMPLE) 2023-07-24 13:06:47,504 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0002_000001 (auth:SIMPLE) 2023-07-24 13:06:47,869 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:06:52,060 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0002_000001 (auth:SIMPLE) 2023-07-24 13:06:54,295 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0002_000001 (auth:SIMPLE) 2023-07-24 13:06:58,760 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:06:58,767 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:06:58,775 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 13:06:58,775 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:06:58,776 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:06:58,776 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 13:06:58,777 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 13:06:58,777 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 13:06:58,777 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204003965/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204003965/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 13:06:58,777 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204003965/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 13:06:58,777 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204003965/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 13:06:58,785 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 13:06:58,786 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 13:06:58,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:06:58,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 13:06:58,791 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204018791"}]},"ts":"1690204018791"} 2023-07-24 13:06:58,792 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 13:06:58,794 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 13:06:58,795 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fbb2cf2e54c6f63a3fab5b42c7023cde, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6da6c7fd5275f62b8e1550e04a2b77b2, UNASSIGN}] 2023-07-24 13:06:58,797 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fbb2cf2e54c6f63a3fab5b42c7023cde, UNASSIGN 2023-07-24 13:06:58,797 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6da6c7fd5275f62b8e1550e04a2b77b2, UNASSIGN 2023-07-24 13:06:58,798 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=fbb2cf2e54c6f63a3fab5b42c7023cde, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:58,798 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6da6c7fd5275f62b8e1550e04a2b77b2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:58,798 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204018798"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204018798"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204018798"}]},"ts":"1690204018798"} 2023-07-24 13:06:58,798 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204018798"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204018798"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204018798"}]},"ts":"1690204018798"} 2023-07-24 13:06:58,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure fbb2cf2e54c6f63a3fab5b42c7023cde, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:06:58,801 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure 6da6c7fd5275f62b8e1550e04a2b77b2, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:06:58,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 13:06:58,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:58,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fbb2cf2e54c6f63a3fab5b42c7023cde, disabling compactions & flushes 2023-07-24 13:06:58,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:58,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:58,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. after waiting 0 ms 2023-07-24 13:06:58,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:58,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:58,953 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6da6c7fd5275f62b8e1550e04a2b77b2, disabling compactions & flushes 2023-07-24 13:06:58,953 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:58,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:58,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. after waiting 0 ms 2023-07-24 13:06:58,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:58,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:06:58,970 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:06:58,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:58,971 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:06:58,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2. 2023-07-24 13:06:58,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6da6c7fd5275f62b8e1550e04a2b77b2: 2023-07-24 13:06:58,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde. 2023-07-24 13:06:58,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fbb2cf2e54c6f63a3fab5b42c7023cde: 2023-07-24 13:06:58,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:58,975 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=6da6c7fd5275f62b8e1550e04a2b77b2, regionState=CLOSED 2023-07-24 13:06:58,975 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204018975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204018975"}]},"ts":"1690204018975"} 2023-07-24 13:06:58,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:58,976 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=fbb2cf2e54c6f63a3fab5b42c7023cde, regionState=CLOSED 2023-07-24 13:06:58,976 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690204018975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204018975"}]},"ts":"1690204018975"} 2023-07-24 13:06:58,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-24 13:06:58,979 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure 6da6c7fd5275f62b8e1550e04a2b77b2, server=jenkins-hbase4.apache.org,36751,1690203972794 in 176 msec 2023-07-24 13:06:58,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-24 13:06:58,980 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure fbb2cf2e54c6f63a3fab5b42c7023cde, server=jenkins-hbase4.apache.org,43049,1690203972978 in 178 msec 2023-07-24 13:06:58,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6da6c7fd5275f62b8e1550e04a2b77b2, UNASSIGN in 184 msec 2023-07-24 13:06:58,981 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=37, resume processing ppid=36 2023-07-24 13:06:58,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=fbb2cf2e54c6f63a3fab5b42c7023cde, UNASSIGN in 185 msec 2023-07-24 13:06:58,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204018982"}]},"ts":"1690204018982"} 2023-07-24 13:06:58,983 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 13:06:58,985 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 13:06:58,987 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 200 msec 2023-07-24 13:06:59,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 13:06:59,093 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 13:06:59,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 13:06:59,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:06:59,097 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:06:59,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 13:06:59,098 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:06:59,100 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 13:06:59,103 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:06:59,103 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:06:59,103 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:06:59,103 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:06:59,103 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 13:06:59,103 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 13:06:59,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 13:06:59,104 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 13:06:59,104 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:59,104 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:59,104 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:06:59,104 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:06:59,104 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:06:59,104 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 13:06:59,104 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:59,105 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:59,104 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:59,104 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:59,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 13:06:59,107 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/recovered.edits] 2023-07-24 13:06:59,107 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/recovered.edits] 2023-07-24 13:06:59,112 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/cf/d1fec2409f8a45579e1d63874596063e to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/cf/d1fec2409f8a45579e1d63874596063e 2023-07-24 13:06:59,112 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/cf/ff293dabe5df43319b1421f0a25d0162 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/cf/ff293dabe5df43319b1421f0a25d0162 2023-07-24 13:06:59,116 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde/recovered.edits/9.seqid 2023-07-24 13:06:59,116 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2/recovered.edits/9.seqid 2023-07-24 13:06:59,117 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/fbb2cf2e54c6f63a3fab5b42c7023cde 2023-07-24 13:06:59,117 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemState/6da6c7fd5275f62b8e1550e04a2b77b2 2023-07-24 13:06:59,117 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 13:06:59,120 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:06:59,122 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 13:06:59,125 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 13:06:59,126 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:06:59,126 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 13:06:59,126 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204019126"}]},"ts":"9223372036854775807"} 2023-07-24 13:06:59,126 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204019126"}]},"ts":"9223372036854775807"} 2023-07-24 13:06:59,128 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:06:59,128 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => fbb2cf2e54c6f63a3fab5b42c7023cde, NAME => 'testtb-testExportFileSystemState,,1690204002619.fbb2cf2e54c6f63a3fab5b42c7023cde.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 6da6c7fd5275f62b8e1550e04a2b77b2, NAME => 'testtb-testExportFileSystemState,1,1690204002619.6da6c7fd5275f62b8e1550e04a2b77b2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:06:59,128 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 13:06:59,129 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204019128"}]},"ts":"9223372036854775807"} 2023-07-24 13:06:59,130 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 13:06:59,132 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 13:06:59,133 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 38 msec 2023-07-24 13:06:59,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 13:06:59,207 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 13:06:59,215 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 13:06:59,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 13:06:59,219 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 13:06:59,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 13:06:59,246 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemState Thread=768 (was 755) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1949 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-870309959_1 at /127.0.0.1:50714 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-870309959_1 at /127.0.0.1:47004 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:50748 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:43547 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Parameter Sending Thread #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:47016 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:45183 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) - Thread LEAK? -, OpenFileDescriptor=922 (was 921) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=316 (was 265) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 179), AvailableMemoryMB=5832 (was 6135) 2023-07-24 13:06:59,246 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-24 13:06:59,266 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=768, OpenFileDescriptor=920, MaxFileDescriptor=60000, SystemLoadAverage=316, ProcessCount=179, AvailableMemoryMB=5831 2023-07-24 13:06:59,267 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=768 is superior to 500 2023-07-24 13:06:59,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 13:06:59,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:06:59,272 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:06:59,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 13:06:59,273 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:06:59,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 13:06:59,275 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad 2023-07-24 13:06:59,275 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:06:59,276 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad empty. 2023-07-24 13:06:59,276 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2 empty. 2023-07-24 13:06:59,276 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad 2023-07-24 13:06:59,276 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:06:59,276 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 13:06:59,293 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 13:06:59,295 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 359619374853e0814e6acf06d790fdad, NAME => 'testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:06:59,295 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ed0af44564f0d3beb23e9b0cbabbfef2, NAME => 'testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:06:59,315 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:59,319 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ed0af44564f0d3beb23e9b0cbabbfef2, disabling compactions & flushes 2023-07-24 13:06:59,319 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:06:59,319 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:06:59,319 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. after waiting 0 ms 2023-07-24 13:06:59,319 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:06:59,319 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:06:59,319 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ed0af44564f0d3beb23e9b0cbabbfef2: 2023-07-24 13:06:59,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:59,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 359619374853e0814e6acf06d790fdad, disabling compactions & flushes 2023-07-24 13:06:59,322 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:06:59,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:06:59,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. after waiting 0 ms 2023-07-24 13:06:59,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:06:59,322 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:06:59,322 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 359619374853e0814e6acf06d790fdad: 2023-07-24 13:06:59,325 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:06:59,327 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204019327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204019327"}]},"ts":"1690204019327"} 2023-07-24 13:06:59,327 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204019327"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204019327"}]},"ts":"1690204019327"} 2023-07-24 13:06:59,329 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:06:59,330 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:06:59,330 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204019330"}]},"ts":"1690204019330"} 2023-07-24 13:06:59,331 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 13:06:59,340 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:06:59,342 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:06:59,342 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:06:59,342 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:06:59,342 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:06:59,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=359619374853e0814e6acf06d790fdad, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0af44564f0d3beb23e9b0cbabbfef2, ASSIGN}] 2023-07-24 13:06:59,345 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0af44564f0d3beb23e9b0cbabbfef2, ASSIGN 2023-07-24 13:06:59,345 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=359619374853e0814e6acf06d790fdad, ASSIGN 2023-07-24 13:06:59,346 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0af44564f0d3beb23e9b0cbabbfef2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43049,1690203972978; forceNewPlan=false, retain=false 2023-07-24 13:06:59,346 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=359619374853e0814e6acf06d790fdad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36483,1690203972884; forceNewPlan=false, retain=false 2023-07-24 13:06:59,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 13:06:59,496 INFO [jenkins-hbase4:42065] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:06:59,499 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=359619374853e0814e6acf06d790fdad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,499 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ed0af44564f0d3beb23e9b0cbabbfef2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,499 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204019499"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204019499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204019499"}]},"ts":"1690204019499"} 2023-07-24 13:06:59,499 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204019499"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204019499"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204019499"}]},"ts":"1690204019499"} 2023-07-24 13:06:59,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=43, state=RUNNABLE; OpenRegionProcedure 359619374853e0814e6acf06d790fdad, server=jenkins-hbase4.apache.org,36483,1690203972884}] 2023-07-24 13:06:59,502 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=44, state=RUNNABLE; OpenRegionProcedure ed0af44564f0d3beb23e9b0cbabbfef2, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:06:59,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 13:06:59,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:06:59,660 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:06:59,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 359619374853e0814e6acf06d790fdad, NAME => 'testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:06:59,660 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ed0af44564f0d3beb23e9b0cbabbfef2, NAME => 'testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:06:59,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. service=AccessControlService 2023-07-24 13:06:59,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. service=AccessControlService 2023-07-24 13:06:59,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:59,661 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:06:59,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 359619374853e0814e6acf06d790fdad 2023-07-24 13:06:59,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:06:59,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:59,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:06:59,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 359619374853e0814e6acf06d790fdad 2023-07-24 13:06:59,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:06:59,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:06:59,661 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 359619374853e0814e6acf06d790fdad 2023-07-24 13:06:59,662 INFO [StoreOpener-359619374853e0814e6acf06d790fdad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 359619374853e0814e6acf06d790fdad 2023-07-24 13:06:59,662 INFO [StoreOpener-ed0af44564f0d3beb23e9b0cbabbfef2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:06:59,664 DEBUG [StoreOpener-359619374853e0814e6acf06d790fdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/cf 2023-07-24 13:06:59,664 DEBUG [StoreOpener-ed0af44564f0d3beb23e9b0cbabbfef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/cf 2023-07-24 13:06:59,664 DEBUG [StoreOpener-ed0af44564f0d3beb23e9b0cbabbfef2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/cf 2023-07-24 13:06:59,664 DEBUG [StoreOpener-359619374853e0814e6acf06d790fdad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/cf 2023-07-24 13:06:59,664 INFO [StoreOpener-ed0af44564f0d3beb23e9b0cbabbfef2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ed0af44564f0d3beb23e9b0cbabbfef2 columnFamilyName cf 2023-07-24 13:06:59,664 INFO [StoreOpener-359619374853e0814e6acf06d790fdad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 359619374853e0814e6acf06d790fdad columnFamilyName cf 2023-07-24 13:06:59,665 INFO [StoreOpener-ed0af44564f0d3beb23e9b0cbabbfef2-1] regionserver.HStore(310): Store=ed0af44564f0d3beb23e9b0cbabbfef2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:59,665 INFO [StoreOpener-359619374853e0814e6acf06d790fdad-1] regionserver.HStore(310): Store=359619374853e0814e6acf06d790fdad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:06:59,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:06:59,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad 2023-07-24 13:06:59,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:06:59,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad 2023-07-24 13:06:59,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:06:59,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 359619374853e0814e6acf06d790fdad 2023-07-24 13:06:59,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:59,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:06:59,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ed0af44564f0d3beb23e9b0cbabbfef2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62921898, jitterRate=-0.062390655279159546}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:59,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ed0af44564f0d3beb23e9b0cbabbfef2: 2023-07-24 13:06:59,672 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 359619374853e0814e6acf06d790fdad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71389264, jitterRate=0.06378293037414551}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:06:59,672 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 359619374853e0814e6acf06d790fdad: 2023-07-24 13:06:59,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2., pid=46, masterSystemTime=1690204019654 2023-07-24 13:06:59,673 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad., pid=45, masterSystemTime=1690204019653 2023-07-24 13:06:59,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:06:59,676 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:06:59,677 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ed0af44564f0d3beb23e9b0cbabbfef2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:06:59,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:06:59,677 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204019677"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204019677"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204019677"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204019677"}]},"ts":"1690204019677"} 2023-07-24 13:06:59,678 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=359619374853e0814e6acf06d790fdad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,679 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204019678"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204019678"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204019678"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204019678"}]},"ts":"1690204019678"} 2023-07-24 13:06:59,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=44 2023-07-24 13:06:59,681 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=44, state=SUCCESS; OpenRegionProcedure ed0af44564f0d3beb23e9b0cbabbfef2, server=jenkins-hbase4.apache.org,43049,1690203972978 in 177 msec 2023-07-24 13:06:59,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=43 2023-07-24 13:06:59,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0af44564f0d3beb23e9b0cbabbfef2, ASSIGN in 339 msec 2023-07-24 13:06:59,682 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=43, state=SUCCESS; OpenRegionProcedure 359619374853e0814e6acf06d790fdad, server=jenkins-hbase4.apache.org,36483,1690203972884 in 179 msec 2023-07-24 13:06:59,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-24 13:06:59,684 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=359619374853e0814e6acf06d790fdad, ASSIGN in 340 msec 2023-07-24 13:06:59,685 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:06:59,685 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204019685"}]},"ts":"1690204019685"} 2023-07-24 13:06:59,687 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 13:06:59,689 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:06:59,689 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 13:06:59,691 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 13:06:59,693 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:59,693 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:59,693 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:59,693 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:06:59,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:59,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:59,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:59,694 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 13:06:59,696 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 425 msec 2023-07-24 13:06:59,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 13:06:59,877 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 13:06:59,878 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testConsecutiveExports get assigned. Timeout = 60000ms 2023-07-24 13:06:59,878 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:59,881 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3484): All regions for table testtb-testConsecutiveExports assigned to meta. Checking AM states. 2023-07-24 13:06:59,881 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:06:59,881 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3504): All regions for table testtb-testConsecutiveExports assigned. 2023-07-24 13:06:59,884 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:06:59,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204019884 (current time:1690204019884). 2023-07-24 13:06:59,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:06:59,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x6bbf544f to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:59,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@514d9d04, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:59,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:59,894 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52084, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:59,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bbf544f to 127.0.0.1:59137 2023-07-24 13:06:59,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:59,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x7cecf0fd to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:06:59,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6de0de03, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:06:59,902 DEBUG [hconnection-0x5078db06-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:59,905 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52094, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:59,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:06:59,911 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55210, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:06:59,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7cecf0fd to 127.0.0.1:59137 2023-07-24 13:06:59,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:06:59,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 13:06:59,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:06:59,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:06:59,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:06:59,916 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:06:59,917 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690204619917 2023-07-24 13:06:59,917 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 13:06:59,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:06:59,918 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:06:59,918 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:06:59,918 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:06:59,919 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:06:59,920 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-24 13:06:59,921 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:06:59,922 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690204619922 2023-07-24 13:06:59,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,938 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 13:06:59,938 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:59,939 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 13:06:59,939 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 13:06:59,940 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,940 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,942 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:59,942 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:59,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:59,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:59,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:59,942 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:06:59,942 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,942 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:06:59,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:59,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:06:59,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,943 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,943 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,943 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 13:06:59,943 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:06:59,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,943 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,944 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:06:59,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 13:06:59,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 13:06:59,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,944 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:06:59,944 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,944 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:06:59,944 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:06:59,944 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:59,946 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:06:59,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,947 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,947 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:06:59,947 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:06:59,947 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:59,947 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:06:59,947 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:06:59,947 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:06:59,947 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 13:06:59,947 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 13:06:59,947 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:06:59,950 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:06:59,951 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:06:59,951 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 13:06:59,952 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,953 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,953 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,953 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,953 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:59,953 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,953 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:59,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:59,953 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,953 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:59,953 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,953 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:06:59,953 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:59,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:59,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:59,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:59,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 13:06:59,956 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2520260c[Count = 1] remaining members to acquire global barrier 2023-07-24 13:06:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:59,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:59,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:59,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 13:06:59,959 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2520260c[Count = 0] remaining members to acquire global barrier 2023-07-24 13:06:59,959 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 13:06:59,959 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,960 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,960 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,960 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,960 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:06:59,960 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 13:06:59,960 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:06:59,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,960 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,960 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,960 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:06:59,960 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,961 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:06:59,961 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:59,961 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:59,961 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:06:59,961 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. started... 2023-07-24 13:06:59,961 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,961 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:06:59,966 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:06:59,966 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:06:59,966 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 359619374853e0814e6acf06d790fdad: 2023-07-24 13:06:59,966 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:06:59,966 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:06:59,967 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:59,967 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,966 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. started... 2023-07-24 13:06:59,968 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:59,967 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 13:06:59,968 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:06:59,969 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed0af44564f0d3beb23e9b0cbabbfef2: 2023-07-24 13:06:59,969 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,969 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:06:59,970 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:06:59,987 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. completed. 2023-07-24 13:06:59,987 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:06:59,987 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:59,988 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:59,988 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,988 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. completed. 2023-07-24 13:06:59,988 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 13:06:59,988 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:06:59,988 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:06:59,988 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:06:59,988 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:06:59,988 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,988 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 13:06:59,988 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:06:59,990 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,990 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:06:59,990 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:06:59,990 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:59,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,990 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:59,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:59,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:59,990 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 13:06:59,990 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:06:59,992 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 13:06:59,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:59,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:06:59,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:59,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:06:59,998 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 13:06:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:06:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:06:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:06:59,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:06:59,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:06:59,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:06:59,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:06:59,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:06:59,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36483,1690203972884': 2023-07-24 13:07:00,001 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 13:07:00,001 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 13:07:00,001 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:00,001 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:00,001 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,001 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:00,003 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:00,003 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,003 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,003 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:00,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,004 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,004 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:00,005 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:00,007 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,007 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,007 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,008 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,010 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:00,010 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:00,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:00,010 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:00,010 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,010 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:00,010 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:00,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:00,010 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,010 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:00,010 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,010 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,010 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:00,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:00,011 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,011 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,013 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,013 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,013 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,013 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,013 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,013 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,013 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,013 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,013 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,013 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,014 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,018 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:00,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 13:07:00,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:00,020 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:00,044 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,084 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 13:07:00,084 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,084 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:00,085 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690204019917Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690204020010 (+93 ms)Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690204020011 (+1 ms)Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690204020019 (+8 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690204020037 (+18 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690204020084 (+47 ms) 2023-07-24 13:07:00,092 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:07:00,096 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 174 msec 2023-07-24 13:07:00,220 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:00,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 13:07:00,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:00,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36483] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:07:00,231 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:07:00,234 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 13:07:00,234 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:07:00,236 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:00,251 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:07:00,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204020251 (current time:1690204020251). 2023-07-24 13:07:00,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:00,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x273785b1 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:00,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@178bb7e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:00,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:00,275 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52102, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:00,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x273785b1 to 127.0.0.1:59137 2023-07-24 13:07:00,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:00,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x335f471c to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:00,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28de56cb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:00,287 DEBUG [hconnection-0x6220d89c-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:00,298 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52110, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:00,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:00,306 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55224, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:00,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x335f471c to 127.0.0.1:59137 2023-07-24 13:07:00,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:00,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 13:07:00,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:00,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:07:00,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:07:00,316 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:07:00,317 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690204620317 2023-07-24 13:07:00,317 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 13:07:00,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 13:07:00,319 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:00,319 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:00,320 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:07:00,321 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 13:07:00,328 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 10 msec 2023-07-24 13:07:00,331 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:07:00,332 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690204620332 2023-07-24 13:07:00,359 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 13:07:00,359 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 13:07:00,359 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:00,361 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 13:07:00,361 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 13:07:00,362 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,362 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,364 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:00,364 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:00,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:00,364 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:00,364 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:00,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:00,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:00,364 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,364 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,374 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,374 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,374 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:00,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 13:07:00,377 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,377 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,378 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:07:00,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 13:07:00,378 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,378 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:07:00,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 13:07:00,388 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:07:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 13:07:00,388 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 13:07:00,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,388 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:00,388 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:07:00,389 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:00,389 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:07:00,390 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:07:00,389 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 13:07:00,390 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 13:07:00,391 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:07:00,391 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:07:00,391 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 13:07:00,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 13:07:00,391 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 13:07:00,391 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:00,393 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 13:07:00,393 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 13:07:00,393 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 13:07:00,393 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,393 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,394 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,394 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:00,394 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,394 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:00,395 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,396 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,396 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:00,396 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,396 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:00,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:00,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:00,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:00,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:00,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:00,403 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 13:07:00,404 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39f256f4[Count = 1] remaining members to acquire global barrier 2023-07-24 13:07:00,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:00,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:00,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:00,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:00,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:00,407 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,408 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,409 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:00,409 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 13:07:00,410 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@39f256f4[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:00,410 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 13:07:00,410 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,411 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,412 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:07:00,412 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,412 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,412 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,412 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:07:00,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,412 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 13:07:00,412 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:07:00,412 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,413 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:00,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,413 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 13:07:00,414 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:00,415 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:00,415 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:07:00,415 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. started... 2023-07-24 13:07:00,415 INFO [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 359619374853e0814e6acf06d790fdad 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 13:07:00,419 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:07:00,420 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:00,420 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:00,420 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 13:07:00,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 13:07:00,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:00,421 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:00,424 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:00,430 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:00,430 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:07:00,430 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. started... 2023-07-24 13:07:00,430 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ed0af44564f0d3beb23e9b0cbabbfef2 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 13:07:00,503 INFO [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=199 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/.tmp/cf/c9c368bbb0564744889f4c92db5a8b5e 2023-07-24 13:07:00,504 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.06 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/.tmp/cf/2c678d5623584525865b763a07b95af9 2023-07-24 13:07:00,518 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/.tmp/cf/c9c368bbb0564744889f4c92db5a8b5e as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/cf/c9c368bbb0564744889f4c92db5a8b5e 2023-07-24 13:07:00,521 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/.tmp/cf/2c678d5623584525865b763a07b95af9 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/cf/2c678d5623584525865b763a07b95af9 2023-07-24 13:07:00,531 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/cf/2c678d5623584525865b763a07b95af9, entries=47, sequenceid=6, filesize=8.0 K 2023-07-24 13:07:00,533 INFO [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/cf/c9c368bbb0564744889f4c92db5a8b5e, entries=3, sequenceid=6, filesize=5.0 K 2023-07-24 13:07:00,535 INFO [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 359619374853e0814e6acf06d790fdad in 120ms, sequenceid=6, compaction requested=false 2023-07-24 13:07:00,535 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 13:07:00,533 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for ed0af44564f0d3beb23e9b0cbabbfef2 in 103ms, sequenceid=6, compaction requested=false 2023-07-24 13:07:00,535 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 13:07:00,536 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 359619374853e0814e6acf06d790fdad: 2023-07-24 13:07:00,538 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 13:07:00,538 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ed0af44564f0d3beb23e9b0cbabbfef2: 2023-07-24 13:07:00,538 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:00,538 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/cf/c9c368bbb0564744889f4c92db5a8b5e] hfiles 2023-07-24 13:07:00,538 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/cf/c9c368bbb0564744889f4c92db5a8b5e for snapshot=snaptb0-testConsecutiveExports 2023-07-24 13:07:00,538 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 13:07:00,539 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:00,539 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/cf/2c678d5623584525865b763a07b95af9] hfiles 2023-07-24 13:07:00,539 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/cf/2c678d5623584525865b763a07b95af9 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 13:07:00,574 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. completed. 2023-07-24 13:07:00,574 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 13:07:00,575 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. completed. 2023-07-24 13:07:00,575 DEBUG [rs(jenkins-hbase4.apache.org,36483,1690203972884)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 13:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:07:00,575 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:07:00,577 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,577 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,577 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:07:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:00,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:00,577 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 13:07:00,577 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:00,577 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 13:07:00,577 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:00,579 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 13:07:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:00,581 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:00,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:00,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,582 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:07:00,586 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 13:07:00,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:00,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:00,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:00,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:00,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:00,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:00,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,36483,1690203972884': 2023-07-24 13:07:00,590 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 13:07:00,590 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 13:07:00,590 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:00,590 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:00,590 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 13:07:00,590 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:00,592 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,593 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,593 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,593 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,593 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:00,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:00,593 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,598 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,599 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,599 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,600 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,600 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:00,600 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:00,601 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:00,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,603 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:00,603 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 13:07:00,604 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,618 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:00,618 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:00,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:00,619 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,618 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:00,619 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,619 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:00,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:00,619 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:00,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:00,618 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,618 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:00,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:00,619 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 13:07:00,621 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 13:07:00,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:00,619 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,621 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:00,622 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,622 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,622 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:00,622 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,622 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,622 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:00,622 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:00,622 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,622 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 13:07:00,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,623 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:00,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,623 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:00,623 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:00,623 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:07:00,663 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,699 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 13:07:00,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,699 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,699 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690204020317Consolidate snapshot: snaptb0-testConsecutiveExports at 1690204020621 (+304 ms)Loading Region manifests for snaptb0-testConsecutiveExports at 1690204020621Writing data manifest for snaptb0-testConsecutiveExports at 1690204020635 (+14 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690204020650 (+15 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690204020699 (+49 ms) 2023-07-24 13:07:00,702 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 13:07:00,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 383 msec 2023-07-24 13:07:00,923 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:00,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 13:07:00,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:00,925 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925 2023-07-24 13:07:00,925 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925, srcFsUri=hdfs://localhost:35185, srcDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:07:00,948 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:07:00,948 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@122a1728, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,948 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83, snapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 13:07:00,956 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:00,968 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:00,969 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:00,969 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:00,970 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:01,958 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-1061292866456000949.jar 2023-07-24 13:07:01,958 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:01,959 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,033 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-7456500696013612974.jar 2023-07-24 13:07:02,034 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,034 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,034 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,035 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,035 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,035 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:02,036 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:07:02,036 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:07:02,037 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:07:02,037 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:07:02,038 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:07:02,038 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:07:02,038 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:07:02,039 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:07:02,039 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:07:02,040 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:07:02,040 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:02,041 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:02,041 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:02,041 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:02,042 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:02,042 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:02,043 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:02,501 WARN [Listener at jenkins-hbase4.apache.org/43547] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:07:02,504 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 13:07:02,506 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 13:07:03,618 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:03,618 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:03,621 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0002_000001 (auth:SIMPLE) 2023-07-24 13:07:04,050 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0003_000001 (auth:SIMPLE) 2023-07-24 13:07:04,561 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:07:08,841 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0003_000001 (auth:SIMPLE) 2023-07-24 13:07:11,068 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0003_000001 (auth:SIMPLE) 2023-07-24 13:07:13,713 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0003_000001 (auth:SIMPLE) 2023-07-24 13:07:15,691 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:07:15,692 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:07:15,695 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 13:07:15,695 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:07:15,696 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:07:15,696 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 13:07:15,698 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 13:07:15,698 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 13:07:15,698 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@56ba3fc5 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 13:07:15,699 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 13:07:15,699 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 13:07:15,700 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925, srcFsUri=hdfs://localhost:35185, srcDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:07:15,723 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:07:15,723 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@31dc844d, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:15,723 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83, snapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 13:07:15,731 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 13:07:15,746 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:15,746 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:15,747 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:15,747 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,644 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-9063066636487400817.jar 2023-07-24 13:07:16,645 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,645 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,728 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-3755406764936550844.jar 2023-07-24 13:07:16,728 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,729 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,730 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,730 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,731 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,731 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:16,732 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:07:16,733 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:07:16,733 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:07:16,734 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:07:16,734 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:07:16,735 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:07:16,736 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:07:16,736 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:07:16,737 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:07:16,737 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:07:16,738 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:16,739 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:16,740 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:16,740 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:16,741 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:16,741 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:16,742 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:17,163 WARN [Listener at jenkins-hbase4.apache.org/43547] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:07:17,166 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 13:07:17,168 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 13:07:19,887 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:19,887 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:19,890 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0003_000001 (auth:SIMPLE) 2023-07-24 13:07:20,633 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0004_000001 (auth:SIMPLE) 2023-07-24 13:07:25,187 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0004_000001 (auth:SIMPLE) 2023-07-24 13:07:27,426 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0004_000001 (auth:SIMPLE) 2023-07-24 13:07:30,887 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0004_000001 (auth:SIMPLE) 2023-07-24 13:07:32,454 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:07:32,454 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:07:32,459 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 13:07:32,460 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:07:32,460 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:07:32,460 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 13:07:32,468 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 13:07:32,468 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 13:07:32,468 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@56ba3fc5 in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 13:07:32,468 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 13:07:32,469 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/local-export-1690204020925/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 13:07:32,485 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 13:07:32,486 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 13:07:32,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:32,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 13:07:32,497 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204052497"}]},"ts":"1690204052497"} 2023-07-24 13:07:32,500 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 13:07:32,503 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 13:07:32,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=359619374853e0814e6acf06d790fdad, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0af44564f0d3beb23e9b0cbabbfef2, UNASSIGN}] 2023-07-24 13:07:32,509 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=359619374853e0814e6acf06d790fdad, UNASSIGN 2023-07-24 13:07:32,510 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0af44564f0d3beb23e9b0cbabbfef2, UNASSIGN 2023-07-24 13:07:32,511 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=359619374853e0814e6acf06d790fdad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:32,511 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204052511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204052511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204052511"}]},"ts":"1690204052511"} 2023-07-24 13:07:32,513 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ed0af44564f0d3beb23e9b0cbabbfef2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:32,514 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204052513"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204052513"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204052513"}]},"ts":"1690204052513"} 2023-07-24 13:07:32,514 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 359619374853e0814e6acf06d790fdad, server=jenkins-hbase4.apache.org,36483,1690203972884}] 2023-07-24 13:07:32,522 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure ed0af44564f0d3beb23e9b0cbabbfef2, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:07:32,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 13:07:32,673 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 359619374853e0814e6acf06d790fdad 2023-07-24 13:07:32,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 359619374853e0814e6acf06d790fdad, disabling compactions & flushes 2023-07-24 13:07:32,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:07:32,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:07:32,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. after waiting 0 ms 2023-07-24 13:07:32,674 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:07:32,674 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:07:32,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ed0af44564f0d3beb23e9b0cbabbfef2, disabling compactions & flushes 2023-07-24 13:07:32,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:07:32,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:07:32,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. after waiting 0 ms 2023-07-24 13:07:32,675 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:07:32,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:07:32,712 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:32,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad. 2023-07-24 13:07:32,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 359619374853e0814e6acf06d790fdad: 2023-07-24 13:07:32,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:07:32,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 359619374853e0814e6acf06d790fdad 2023-07-24 13:07:32,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:32,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2. 2023-07-24 13:07:32,717 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ed0af44564f0d3beb23e9b0cbabbfef2: 2023-07-24 13:07:32,718 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=359619374853e0814e6acf06d790fdad, regionState=CLOSED 2023-07-24 13:07:32,718 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204052718"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204052718"}]},"ts":"1690204052718"} 2023-07-24 13:07:32,719 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:07:32,720 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ed0af44564f0d3beb23e9b0cbabbfef2, regionState=CLOSED 2023-07-24 13:07:32,720 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690204052720"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204052720"}]},"ts":"1690204052720"} 2023-07-24 13:07:32,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-24 13:07:32,724 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 359619374853e0814e6acf06d790fdad, server=jenkins-hbase4.apache.org,36483,1690203972884 in 207 msec 2023-07-24 13:07:32,728 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-24 13:07:32,728 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=359619374853e0814e6acf06d790fdad, UNASSIGN in 219 msec 2023-07-24 13:07:32,729 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure ed0af44564f0d3beb23e9b0cbabbfef2, server=jenkins-hbase4.apache.org,43049,1690203972978 in 201 msec 2023-07-24 13:07:32,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=53, resume processing ppid=51 2023-07-24 13:07:32,735 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ed0af44564f0d3beb23e9b0cbabbfef2, UNASSIGN in 223 msec 2023-07-24 13:07:32,736 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204052736"}]},"ts":"1690204052736"} 2023-07-24 13:07:32,738 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 13:07:32,741 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 13:07:32,759 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 260 msec 2023-07-24 13:07:32,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 13:07:32,799 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 13:07:32,800 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 13:07:32,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:32,806 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:32,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 13:07:32,807 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:32,813 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 13:07:32,818 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:32,818 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:32,818 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:32,818 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:32,818 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 13:07:32,819 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 13:07:32,819 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 13:07:32,819 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 13:07:32,820 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:32,820 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:32,820 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:32,820 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:32,820 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:32,820 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 13:07:32,820 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:32,820 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad 2023-07-24 13:07:32,820 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:32,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 13:07:32,822 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:07:32,828 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/recovered.edits] 2023-07-24 13:07:32,828 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/recovered.edits] 2023-07-24 13:07:32,853 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/cf/2c678d5623584525865b763a07b95af9 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/cf/2c678d5623584525865b763a07b95af9 2023-07-24 13:07:32,857 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2/recovered.edits/9.seqid 2023-07-24 13:07:32,858 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/ed0af44564f0d3beb23e9b0cbabbfef2 2023-07-24 13:07:32,860 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/cf/c9c368bbb0564744889f4c92db5a8b5e to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/cf/c9c368bbb0564744889f4c92db5a8b5e 2023-07-24 13:07:32,864 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad/recovered.edits/9.seqid 2023-07-24 13:07:32,865 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testConsecutiveExports/359619374853e0814e6acf06d790fdad 2023-07-24 13:07:32,865 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 13:07:32,868 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:32,884 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 13:07:32,901 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 13:07:32,903 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:32,903 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 13:07:32,904 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204052903"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:32,904 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204052903"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:32,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 13:07:32,926 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:07:32,927 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 359619374853e0814e6acf06d790fdad, NAME => 'testtb-testConsecutiveExports,,1690204019268.359619374853e0814e6acf06d790fdad.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ed0af44564f0d3beb23e9b0cbabbfef2, NAME => 'testtb-testConsecutiveExports,1,1690204019268.ed0af44564f0d3beb23e9b0cbabbfef2.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:07:32,927 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 13:07:32,927 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204052927"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:32,944 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 13:07:32,952 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 13:07:32,960 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 151 msec 2023-07-24 13:07:33,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 13:07:33,126 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 13:07:33,140 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 13:07:33,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 13:07:33,159 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 13:07:33,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 13:07:33,203 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testConsecutiveExports Thread=747 (was 768), OpenFileDescriptor=891 (was 920), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=383 (was 316) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 179) - ProcessCount LEAK? -, AvailableMemoryMB=5718 (was 5831) 2023-07-24 13:07:33,203 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-24 13:07:33,233 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=747, OpenFileDescriptor=891, MaxFileDescriptor=60000, SystemLoadAverage=383, ProcessCount=181, AvailableMemoryMB=5717 2023-07-24 13:07:33,233 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=747 is superior to 500 2023-07-24 13:07:33,235 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 13:07:33,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,239 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:07:33,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 13:07:33,240 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:07:33,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 13:07:33,243 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:33,243 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:33,243 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031 empty. 2023-07-24 13:07:33,243 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604 empty. 2023-07-24 13:07:33,244 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:33,244 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:33,244 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 13:07:33,260 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 13:07:33,261 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 16f6f35cec9ff7096a734992da0a3031, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:07:33,261 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 9a317e96b718ebbdd3faa95d2e92f604, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:07:33,279 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:33,279 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 16f6f35cec9ff7096a734992da0a3031, disabling compactions & flushes 2023-07-24 13:07:33,279 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:33,279 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:33,279 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. after waiting 0 ms 2023-07-24 13:07:33,279 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:33,279 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:33,279 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 16f6f35cec9ff7096a734992da0a3031: 2023-07-24 13:07:33,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:33,288 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 9a317e96b718ebbdd3faa95d2e92f604, disabling compactions & flushes 2023-07-24 13:07:33,289 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:33,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:33,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. after waiting 0 ms 2023-07-24 13:07:33,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:33,289 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:33,289 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 9a317e96b718ebbdd3faa95d2e92f604: 2023-07-24 13:07:33,291 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:07:33,292 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204053292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204053292"}]},"ts":"1690204053292"} 2023-07-24 13:07:33,292 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204053292"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204053292"}]},"ts":"1690204053292"} 2023-07-24 13:07:33,299 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:07:33,300 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:07:33,300 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204053300"}]},"ts":"1690204053300"} 2023-07-24 13:07:33,301 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 13:07:33,304 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:07:33,306 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:07:33,306 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:07:33,306 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:07:33,306 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:07:33,306 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=16f6f35cec9ff7096a734992da0a3031, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a317e96b718ebbdd3faa95d2e92f604, ASSIGN}] 2023-07-24 13:07:33,308 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=16f6f35cec9ff7096a734992da0a3031, ASSIGN 2023-07-24 13:07:33,309 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a317e96b718ebbdd3faa95d2e92f604, ASSIGN 2023-07-24 13:07:33,309 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=16f6f35cec9ff7096a734992da0a3031, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36751,1690203972794; forceNewPlan=false, retain=false 2023-07-24 13:07:33,309 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a317e96b718ebbdd3faa95d2e92f604, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43049,1690203972978; forceNewPlan=false, retain=false 2023-07-24 13:07:33,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 13:07:33,460 INFO [jenkins-hbase4:42065] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:07:33,463 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=16f6f35cec9ff7096a734992da0a3031, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:33,463 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=9a317e96b718ebbdd3faa95d2e92f604, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:33,464 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204053463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204053463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204053463"}]},"ts":"1690204053463"} 2023-07-24 13:07:33,464 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204053463"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204053463"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204053463"}]},"ts":"1690204053463"} 2023-07-24 13:07:33,466 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 16f6f35cec9ff7096a734992da0a3031, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:07:33,467 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 9a317e96b718ebbdd3faa95d2e92f604, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:07:33,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 13:07:33,626 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:33,626 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9a317e96b718ebbdd3faa95d2e92f604, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:07:33,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. service=AccessControlService 2023-07-24 13:07:33,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:33,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:33,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:33,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:33,627 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:33,627 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:33,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 16f6f35cec9ff7096a734992da0a3031, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:07:33,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. service=AccessControlService 2023-07-24 13:07:33,628 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:33,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:33,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:33,628 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:33,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:33,631 INFO [StoreOpener-9a317e96b718ebbdd3faa95d2e92f604-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:33,631 INFO [StoreOpener-16f6f35cec9ff7096a734992da0a3031-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:33,633 DEBUG [StoreOpener-9a317e96b718ebbdd3faa95d2e92f604-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/cf 2023-07-24 13:07:33,633 DEBUG [StoreOpener-9a317e96b718ebbdd3faa95d2e92f604-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/cf 2023-07-24 13:07:33,633 DEBUG [StoreOpener-16f6f35cec9ff7096a734992da0a3031-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/cf 2023-07-24 13:07:33,633 DEBUG [StoreOpener-16f6f35cec9ff7096a734992da0a3031-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/cf 2023-07-24 13:07:33,634 INFO [StoreOpener-9a317e96b718ebbdd3faa95d2e92f604-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9a317e96b718ebbdd3faa95d2e92f604 columnFamilyName cf 2023-07-24 13:07:33,634 INFO [StoreOpener-16f6f35cec9ff7096a734992da0a3031-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 16f6f35cec9ff7096a734992da0a3031 columnFamilyName cf 2023-07-24 13:07:33,635 INFO [StoreOpener-9a317e96b718ebbdd3faa95d2e92f604-1] regionserver.HStore(310): Store=9a317e96b718ebbdd3faa95d2e92f604/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:33,636 INFO [StoreOpener-16f6f35cec9ff7096a734992da0a3031-1] regionserver.HStore(310): Store=16f6f35cec9ff7096a734992da0a3031/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:33,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:33,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:33,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:33,638 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:33,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:33,641 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:33,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:33,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:33,645 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 16f6f35cec9ff7096a734992da0a3031; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63470526, jitterRate=-0.054215461015701294}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:33,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 16f6f35cec9ff7096a734992da0a3031: 2023-07-24 13:07:33,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9a317e96b718ebbdd3faa95d2e92f604; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67471544, jitterRate=0.005404353141784668}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:33,646 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9a317e96b718ebbdd3faa95d2e92f604: 2023-07-24 13:07:33,646 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031., pid=60, masterSystemTime=1690204053619 2023-07-24 13:07:33,648 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604., pid=61, masterSystemTime=1690204053619 2023-07-24 13:07:33,649 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:33,649 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:33,651 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=16f6f35cec9ff7096a734992da0a3031, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:33,651 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204053651"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204053651"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204053651"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204053651"}]},"ts":"1690204053651"} 2023-07-24 13:07:33,651 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:33,651 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:33,652 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=9a317e96b718ebbdd3faa95d2e92f604, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:33,652 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204053652"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204053652"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204053652"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204053652"}]},"ts":"1690204053652"} 2023-07-24 13:07:33,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-24 13:07:33,656 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 16f6f35cec9ff7096a734992da0a3031, server=jenkins-hbase4.apache.org,36751,1690203972794 in 187 msec 2023-07-24 13:07:33,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-24 13:07:33,657 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 9a317e96b718ebbdd3faa95d2e92f604, server=jenkins-hbase4.apache.org,43049,1690203972978 in 187 msec 2023-07-24 13:07:33,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=16f6f35cec9ff7096a734992da0a3031, ASSIGN in 350 msec 2023-07-24 13:07:33,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=59, resume processing ppid=57 2023-07-24 13:07:33,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a317e96b718ebbdd3faa95d2e92f604, ASSIGN in 352 msec 2023-07-24 13:07:33,661 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:07:33,661 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204053661"}]},"ts":"1690204053661"} 2023-07-24 13:07:33,668 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 13:07:33,671 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:07:33,671 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 13:07:33,673 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 13:07:33,676 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:33,676 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:33,676 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:33,680 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:33,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:33,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:33,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:33,692 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:33,695 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 457 msec 2023-07-24 13:07:33,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 13:07:33,845 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 13:07:33,845 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithMergeRegion get assigned. Timeout = 60000ms 2023-07-24 13:07:33,845 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:33,859 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned to meta. Checking AM states. 2023-07-24 13:07:33,859 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:33,859 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithMergeRegion assigned. 2023-07-24 13:07:33,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:33,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204053866 (current time:1690204053866). 2023-07-24 13:07:33,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:33,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x75f01017 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:33,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1dd3b4b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:33,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:33,880 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60996, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:33,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x75f01017 to 127.0.0.1:59137 2023-07-24 13:07:33,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:33,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x1137b926 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:33,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@643263bf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:33,905 DEBUG [hconnection-0xc5d0b11-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:33,907 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32774, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:33,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:33,915 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58770, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:33,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1137b926 to 127.0.0.1:59137 2023-07-24 13:07:33,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:33,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 13:07:33,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:33,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:33,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:33,922 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:33,924 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690204653924 2023-07-24 13:07:33,924 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:33,939 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:33,939 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:33,939 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:33,944 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:33,946 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 24 msec 2023-07-24 13:07:33,947 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:33,948 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690204653948 2023-07-24 13:07:33,983 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,983 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 13:07:33,984 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:33,986 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 13:07:33,986 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 13:07:33,987 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,987 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,992 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:33,993 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:33,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:33,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:33,993 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:33,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:33,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:33,993 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:33,993 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:33,993 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:33,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:33,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:33,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,994 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:33,994 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:33,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,995 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 13:07:33,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 13:07:33,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:33,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 13:07:33,995 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:33,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:33,996 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:34,001 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,002 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:34,002 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,002 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:34,002 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:34,004 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:34,004 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:34,002 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,004 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:34,004 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:34,004 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:34,004 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:34,005 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:34,006 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:34,006 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:34,006 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:34,006 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:34,006 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:34,008 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,009 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,009 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:34,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:34,010 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,010 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:34,011 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,011 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:34,010 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:34,010 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,016 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:34,016 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:34,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:34,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 13:07:34,021 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@221fc62c[Count = 1] remaining members to acquire global barrier 2023-07-24 13:07:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:34,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:34,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:34,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 13:07:34,031 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@221fc62c[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:34,031 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 13:07:34,031 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,032 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,032 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,032 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,033 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:34,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,033 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,033 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:34,033 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:34,033 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:07:34,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,033 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:34,034 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,034 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:34,039 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:34,039 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:34,039 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:34,039 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:34,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:34,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:34,041 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:34,044 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:34,044 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:34,044 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. started... 2023-07-24 13:07:34,044 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. started... 2023-07-24 13:07:34,044 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:34,044 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:34,041 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:34,045 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9a317e96b718ebbdd3faa95d2e92f604: 2023-07-24 13:07:34,045 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:34,047 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 16f6f35cec9ff7096a734992da0a3031: 2023-07-24 13:07:34,047 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,047 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:34,047 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:34,048 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:07:34,074 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. completed. 2023-07-24 13:07:34,075 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:34,075 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:07:34,086 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:34,087 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,087 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:34,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:34,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:34,087 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:34,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:34,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:34,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,091 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. completed. 2023-07-24 13:07:34,091 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:34,091 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:07:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,093 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:34,093 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:34,093 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:34,093 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:34,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,094 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:07:34,096 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 13:07:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:34,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:34,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36751,1690203972794': 2023-07-24 13:07:34,105 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 13:07:34,105 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 13:07:34,105 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:34,105 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:34,105 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,105 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:34,107 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,108 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:34,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,108 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:34,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,112 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,112 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:34,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,115 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,116 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,116 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,120 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,120 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:34,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:34,120 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,120 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:34,120 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:34,120 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:34,120 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,120 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,122 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,122 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,122 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:34,122 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:34,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:34,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,120 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,122 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,123 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,123 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:34,122 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:34,123 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,123 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,123 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,123 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,177 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,218 WARN [DataStreamer for file /user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion/.snapshotinfo] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-24 13:07:34,244 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:34,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:34,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:34,245 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:07:34,255 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 13:07:34,255 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,256 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,256 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690204053924Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690204054122 (+198 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690204054122Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690204054128 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690204054160 (+32 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690204054255 (+95 ms) 2023-07-24 13:07:34,259 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:34,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 326 msec 2023-07-24 13:07:34,546 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:34,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:34,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:34,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36751] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:07:34,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:07:34,569 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,569 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:34,569 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:34,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:34,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204054590 (current time:1690204054590). 2023-07-24 13:07:34,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:34,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x42a81efb to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:34,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2559d24d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:34,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:34,616 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32788, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:34,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42a81efb to 127.0.0.1:59137 2023-07-24 13:07:34,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:34,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x17c36f4e to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:34,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@151ee48b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:34,628 DEBUG [hconnection-0x7ebe97df-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:34,631 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32804, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:34,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:34,638 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:34,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x17c36f4e to 127.0.0.1:59137 2023-07-24 13:07:34,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:34,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 13:07:34,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:34,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:34,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:34,647 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:34,647 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690204654647 2023-07-24 13:07:34,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 13:07:34,647 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,649 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:34,649 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:34,652 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:34,652 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 13:07:34,653 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 7 msec 2023-07-24 13:07:34,654 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:34,655 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690204654655 2023-07-24 13:07:34,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,680 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 13:07:34,680 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:34,682 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 13:07:34,683 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 13:07:34,683 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,683 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,685 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:34,685 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:34,686 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,685 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:34,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:34,686 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,686 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,686 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:34,686 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:34,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 13:07:34,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,688 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 13:07:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 13:07:34,688 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:34,688 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,688 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 13:07:34,688 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,688 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:34,688 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:34,688 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:34,690 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:34,692 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:34,693 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:34,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,695 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:34,696 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,696 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 13:07:34,697 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:34,697 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:34,698 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:34,699 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 13:07:34,699 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 13:07:34,699 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:34,699 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 13:07:34,701 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,701 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,701 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:34,701 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,701 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,701 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:34,701 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,701 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:34,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,702 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:34,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 13:07:34,704 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@339488f9[Count = 1] remaining members to acquire global barrier 2023-07-24 13:07:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:34,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:34,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:34,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:34,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 13:07:34,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@339488f9[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:34,707 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 13:07:34,707 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,708 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,708 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,709 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,709 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,709 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:34,709 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:34,709 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:34,709 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:34,709 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,710 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:34,710 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:34,710 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. started... 2023-07-24 13:07:34,710 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,710 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 16f6f35cec9ff7096a734992da0a3031 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 13:07:34,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,710 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:34,710 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:34,710 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 13:07:34,711 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:34,711 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:07:34,711 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:34,711 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. started... 2023-07-24 13:07:34,711 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 9a317e96b718ebbdd3faa95d2e92f604 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 13:07:34,714 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:34,714 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:34,714 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:34,749 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:34,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:34,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:34,759 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:34,766 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/.tmp/cf/73ea16b93a8a4d188ed965c29ba7ce30 2023-07-24 13:07:34,766 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/.tmp/cf/4970aba692164a61a5e8e44f63c40e47 2023-07-24 13:07:34,779 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/.tmp/cf/73ea16b93a8a4d188ed965c29ba7ce30 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/cf/73ea16b93a8a4d188ed965c29ba7ce30 2023-07-24 13:07:34,792 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/.tmp/cf/4970aba692164a61a5e8e44f63c40e47 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/cf/4970aba692164a61a5e8e44f63c40e47 2023-07-24 13:07:34,797 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/cf/73ea16b93a8a4d188ed965c29ba7ce30, entries=4, sequenceid=6, filesize=5.1 K 2023-07-24 13:07:34,798 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 16f6f35cec9ff7096a734992da0a3031 in 88ms, sequenceid=6, compaction requested=false 2023-07-24 13:07:34,798 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 13:07:34,799 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 16f6f35cec9ff7096a734992da0a3031: 2023-07-24 13:07:34,799 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,800 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:34,800 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/cf/73ea16b93a8a4d188ed965c29ba7ce30] hfiles 2023-07-24 13:07:34,800 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/cf/73ea16b93a8a4d188ed965c29ba7ce30 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,809 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/cf/4970aba692164a61a5e8e44f63c40e47, entries=46, sequenceid=6, filesize=7.9 K 2023-07-24 13:07:34,811 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 9a317e96b718ebbdd3faa95d2e92f604 in 100ms, sequenceid=6, compaction requested=false 2023-07-24 13:07:34,816 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 9a317e96b718ebbdd3faa95d2e92f604: 2023-07-24 13:07:34,817 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,817 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:34,817 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/cf/4970aba692164a61a5e8e44f63c40e47] hfiles 2023-07-24 13:07:34,817 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/cf/4970aba692164a61a5e8e44f63c40e47 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,860 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. completed. 2023-07-24 13:07:34,860 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:34,860 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:34,860 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:34,860 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,860 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:34,860 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:07:34,862 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,862 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:34,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:34,862 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:34,862 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:34,862 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:34,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:34,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:34,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:34,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,869 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. completed. 2023-07-24 13:07:34,869 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:34,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,36751,1690203972794': 2023-07-24 13:07:34,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 13:07:34,869 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:34,869 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:34,869 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,869 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 13:07:34,869 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:07:34,871 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 13:07:34,871 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,871 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:34,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:34,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:34,871 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 13:07:34,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:34,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:34,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:34,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:07:34,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 13:07:34,877 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 13:07:34,877 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:34,877 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:34,877 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,877 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:34,887 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,887 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,888 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,887 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,888 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,888 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:34,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,888 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,889 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,889 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:34,890 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:34,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,892 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,893 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,893 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:34,893 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,894 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,899 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:34,899 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:34,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:34,899 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:34,899 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:34,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:34,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,903 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,903 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:34,903 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:34,903 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,903 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:34,903 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:34,903 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,903 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,903 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,903 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:34,903 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,903 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,903 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:34,904 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,904 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:34,904 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:34,904 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,904 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:34,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:34,905 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:34,963 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:34,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:34,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:34,964 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:07:34,976 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,040 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 13:07:35,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,041 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:35,041 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690204054648Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690204054903 (+255 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690204054904 (+1 ms)Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690204054927 (+23 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690204054955 (+28 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690204055040 (+85 ms) 2023-07-24 13:07:35,045 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 13:07:35,051 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 396 msec 2023-07-24 13:07:35,265 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:35,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 13:07:35,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:35,297 DEBUG [Listener at jenkins-hbase4.apache.org/43547] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:07:35,301 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58790, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:07:35,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36483] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 13:07:35,303 DEBUG [Listener at jenkins-hbase4.apache.org/43547] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:07:35,308 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45712, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:07:35,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36751] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 13:07:35,309 DEBUG [Listener at jenkins-hbase4.apache.org/43547] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 13:07:35,313 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32814, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 13:07:35,313 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 13:07:35,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 13:07:35,317 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:35,318 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:07:35,319 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 13:07:35,319 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:07:35,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 13:07:35,322 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:35,322 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:35,323 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f empty. 2023-07-24 13:07:35,323 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c empty. 2023-07-24 13:07:35,323 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:35,323 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:35,323 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 13:07:35,334 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 13:07:35,335 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => a3e64dd7d91d921c059a2da5bccc516f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:07:35,335 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5d5c6f22157290f5731d12fb38908d6c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:07:35,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:35,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing 5d5c6f22157290f5731d12fb38908d6c, disabling compactions & flushes 2023-07-24 13:07:35,354 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:35,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:35,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. after waiting 0 ms 2023-07-24 13:07:35,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:35,354 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:35,354 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for 5d5c6f22157290f5731d12fb38908d6c: 2023-07-24 13:07:35,355 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:35,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing a3e64dd7d91d921c059a2da5bccc516f, disabling compactions & flushes 2023-07-24 13:07:35,356 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:35,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:35,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. after waiting 0 ms 2023-07-24 13:07:35,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:35,356 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:35,356 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for a3e64dd7d91d921c059a2da5bccc516f: 2023-07-24 13:07:35,359 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:07:35,362 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204055361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204055361"}]},"ts":"1690204055361"} 2023-07-24 13:07:35,362 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204055361"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204055361"}]},"ts":"1690204055361"} 2023-07-24 13:07:35,365 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:07:35,366 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:07:35,366 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204055366"}]},"ts":"1690204055366"} 2023-07-24 13:07:35,367 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 13:07:35,372 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:07:35,374 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:07:35,374 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:07:35,374 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:07:35,374 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:07:35,375 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d5c6f22157290f5731d12fb38908d6c, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3e64dd7d91d921c059a2da5bccc516f, ASSIGN}] 2023-07-24 13:07:35,378 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3e64dd7d91d921c059a2da5bccc516f, ASSIGN 2023-07-24 13:07:35,379 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d5c6f22157290f5731d12fb38908d6c, ASSIGN 2023-07-24 13:07:35,381 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3e64dd7d91d921c059a2da5bccc516f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36483,1690203972884; forceNewPlan=false, retain=false 2023-07-24 13:07:35,381 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d5c6f22157290f5731d12fb38908d6c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43049,1690203972978; forceNewPlan=false, retain=false 2023-07-24 13:07:35,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 13:07:35,531 INFO [jenkins-hbase4:42065] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:07:35,535 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=a3e64dd7d91d921c059a2da5bccc516f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:35,535 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5d5c6f22157290f5731d12fb38908d6c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:35,535 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204055535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204055535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204055535"}]},"ts":"1690204055535"} 2023-07-24 13:07:35,536 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204055535"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204055535"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204055535"}]},"ts":"1690204055535"} 2023-07-24 13:07:35,538 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure a3e64dd7d91d921c059a2da5bccc516f, server=jenkins-hbase4.apache.org,36483,1690203972884}] 2023-07-24 13:07:35,539 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure 5d5c6f22157290f5731d12fb38908d6c, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:07:35,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 13:07:35,693 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:35,693 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3e64dd7d91d921c059a2da5bccc516f, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 13:07:35,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. service=AccessControlService 2023-07-24 13:07:35,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:35,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:35,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:35,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:35,694 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:35,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:35,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d5c6f22157290f5731d12fb38908d6c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 13:07:35,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. service=AccessControlService 2023-07-24 13:07:35,695 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:35,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:35,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:35,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:35,695 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:35,696 INFO [StoreOpener-a3e64dd7d91d921c059a2da5bccc516f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:35,697 INFO [StoreOpener-5d5c6f22157290f5731d12fb38908d6c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:35,697 DEBUG [StoreOpener-a3e64dd7d91d921c059a2da5bccc516f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/cf 2023-07-24 13:07:35,697 DEBUG [StoreOpener-a3e64dd7d91d921c059a2da5bccc516f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/cf 2023-07-24 13:07:35,698 INFO [StoreOpener-a3e64dd7d91d921c059a2da5bccc516f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3e64dd7d91d921c059a2da5bccc516f columnFamilyName cf 2023-07-24 13:07:35,698 DEBUG [StoreOpener-5d5c6f22157290f5731d12fb38908d6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/cf 2023-07-24 13:07:35,698 DEBUG [StoreOpener-5d5c6f22157290f5731d12fb38908d6c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/cf 2023-07-24 13:07:35,699 INFO [StoreOpener-5d5c6f22157290f5731d12fb38908d6c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d5c6f22157290f5731d12fb38908d6c columnFamilyName cf 2023-07-24 13:07:35,699 INFO [StoreOpener-a3e64dd7d91d921c059a2da5bccc516f-1] regionserver.HStore(310): Store=a3e64dd7d91d921c059a2da5bccc516f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:35,699 INFO [StoreOpener-5d5c6f22157290f5731d12fb38908d6c-1] regionserver.HStore(310): Store=5d5c6f22157290f5731d12fb38908d6c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:35,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:35,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:35,700 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:35,701 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:35,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:35,705 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:35,708 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:35,709 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a3e64dd7d91d921c059a2da5bccc516f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62926915, jitterRate=-0.06231589615345001}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:35,709 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a3e64dd7d91d921c059a2da5bccc516f: 2023-07-24 13:07:35,710 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f., pid=69, masterSystemTime=1690204055689 2023-07-24 13:07:35,710 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:35,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5d5c6f22157290f5731d12fb38908d6c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67173707, jitterRate=9.662359952926636E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:35,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:35,711 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5d5c6f22157290f5731d12fb38908d6c: 2023-07-24 13:07:35,711 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:35,712 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=a3e64dd7d91d921c059a2da5bccc516f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:35,712 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c., pid=70, masterSystemTime=1690204055691 2023-07-24 13:07:35,712 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204055712"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204055712"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204055712"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204055712"}]},"ts":"1690204055712"} 2023-07-24 13:07:35,713 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:35,714 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:35,714 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=5d5c6f22157290f5731d12fb38908d6c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:35,714 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204055714"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204055714"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204055714"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204055714"}]},"ts":"1690204055714"} 2023-07-24 13:07:35,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-24 13:07:35,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure a3e64dd7d91d921c059a2da5bccc516f, server=jenkins-hbase4.apache.org,36483,1690203972884 in 176 msec 2023-07-24 13:07:35,718 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3e64dd7d91d921c059a2da5bccc516f, ASSIGN in 342 msec 2023-07-24 13:07:35,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-24 13:07:35,723 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure 5d5c6f22157290f5731d12fb38908d6c, server=jenkins-hbase4.apache.org,43049,1690203972978 in 177 msec 2023-07-24 13:07:35,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=67, resume processing ppid=66 2023-07-24 13:07:35,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d5c6f22157290f5731d12fb38908d6c, ASSIGN in 349 msec 2023-07-24 13:07:35,730 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:07:35,730 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204055730"}]},"ts":"1690204055730"} 2023-07-24 13:07:35,735 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 13:07:35,738 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:07:35,739 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 13:07:35,741 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 13:07:35,743 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:35,743 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:35,743 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:35,743 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:35,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,745 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,747 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 429 msec 2023-07-24 13:07:35,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:35,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 13:07:35,924 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 13:07:35,960 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions 5d5c6f22157290f5731d12fb38908d6c, a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:35,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5d5c6f22157290f5731d12fb38908d6c, a3e64dd7d91d921c059a2da5bccc516f], force=true 2023-07-24 13:07:35,972 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5d5c6f22157290f5731d12fb38908d6c, a3e64dd7d91d921c059a2da5bccc516f], force=true 2023-07-24 13:07:35,972 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5d5c6f22157290f5731d12fb38908d6c, a3e64dd7d91d921c059a2da5bccc516f], force=true 2023-07-24 13:07:35,972 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5d5c6f22157290f5731d12fb38908d6c, a3e64dd7d91d921c059a2da5bccc516f], force=true 2023-07-24 13:07:35,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 13:07:36,002 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d5c6f22157290f5731d12fb38908d6c, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3e64dd7d91d921c059a2da5bccc516f, UNASSIGN}] 2023-07-24 13:07:36,005 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d5c6f22157290f5731d12fb38908d6c, UNASSIGN 2023-07-24 13:07:36,006 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3e64dd7d91d921c059a2da5bccc516f, UNASSIGN 2023-07-24 13:07:36,006 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=a3e64dd7d91d921c059a2da5bccc516f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:36,006 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5d5c6f22157290f5731d12fb38908d6c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:36,007 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204056006"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204056006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204056006"}]},"ts":"1690204056006"} 2023-07-24 13:07:36,007 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204056006"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204056006"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204056006"}]},"ts":"1690204056006"} 2023-07-24 13:07:36,008 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=73, state=RUNNABLE; CloseRegionProcedure a3e64dd7d91d921c059a2da5bccc516f, server=jenkins-hbase4.apache.org,36483,1690203972884}] 2023-07-24 13:07:36,009 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=72, state=RUNNABLE; CloseRegionProcedure 5d5c6f22157290f5731d12fb38908d6c, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:07:36,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 13:07:36,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:36,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:36,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a3e64dd7d91d921c059a2da5bccc516f, disabling compactions & flushes 2023-07-24 13:07:36,163 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:36,163 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:36,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5d5c6f22157290f5731d12fb38908d6c, disabling compactions & flushes 2023-07-24 13:07:36,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. after waiting 0 ms 2023-07-24 13:07:36,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:36,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:36,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:36,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a3e64dd7d91d921c059a2da5bccc516f 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 13:07:36,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. after waiting 0 ms 2023-07-24 13:07:36,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:36,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5d5c6f22157290f5731d12fb38908d6c 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 13:07:36,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/.tmp/cf/19dfc800d2084d4bb5a1ee4b72593fad 2023-07-24 13:07:36,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/.tmp/cf/2b88118df15b4978bfec91ffbc5efe55 2023-07-24 13:07:36,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/.tmp/cf/19dfc800d2084d4bb5a1ee4b72593fad as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/cf/19dfc800d2084d4bb5a1ee4b72593fad 2023-07-24 13:07:36,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/.tmp/cf/2b88118df15b4978bfec91ffbc5efe55 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/cf/2b88118df15b4978bfec91ffbc5efe55 2023-07-24 13:07:36,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/cf/19dfc800d2084d4bb5a1ee4b72593fad, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 13:07:36,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for 5d5c6f22157290f5731d12fb38908d6c in 25ms, sequenceid=5, compaction requested=false 2023-07-24 13:07:36,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 13:07:36,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/cf/2b88118df15b4978bfec91ffbc5efe55, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 13:07:36,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for a3e64dd7d91d921c059a2da5bccc516f in 26ms, sequenceid=5, compaction requested=false 2023-07-24 13:07:36,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 13:07:36,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 13:07:36,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:36,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:36,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f. 2023-07-24 13:07:36,204 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c. 2023-07-24 13:07:36,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a3e64dd7d91d921c059a2da5bccc516f: 2023-07-24 13:07:36,204 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5d5c6f22157290f5731d12fb38908d6c: 2023-07-24 13:07:36,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:36,206 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=5d5c6f22157290f5731d12fb38908d6c, regionState=CLOSED 2023-07-24 13:07:36,206 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:36,206 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204056206"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204056206"}]},"ts":"1690204056206"} 2023-07-24 13:07:36,209 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=a3e64dd7d91d921c059a2da5bccc516f, regionState=CLOSED 2023-07-24 13:07:36,209 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690204056209"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204056209"}]},"ts":"1690204056209"} 2023-07-24 13:07:36,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=72 2023-07-24 13:07:36,212 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=72, state=SUCCESS; CloseRegionProcedure 5d5c6f22157290f5731d12fb38908d6c, server=jenkins-hbase4.apache.org,43049,1690203972978 in 201 msec 2023-07-24 13:07:36,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=73 2023-07-24 13:07:36,212 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=73, state=SUCCESS; CloseRegionProcedure a3e64dd7d91d921c059a2da5bccc516f, server=jenkins-hbase4.apache.org,36483,1690203972884 in 203 msec 2023-07-24 13:07:36,214 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=5d5c6f22157290f5731d12fb38908d6c, UNASSIGN in 213 msec 2023-07-24 13:07:36,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-24 13:07:36,214 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=a3e64dd7d91d921c059a2da5bccc516f, UNASSIGN in 210 msec 2023-07-24 13:07:36,278 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 13:07:36,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 13:07:36,284 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055315.5d5c6f22157290f5731d12fb38908d6c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:36,284 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690204055315.a3e64dd7d91d921c059a2da5bccc516f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:36,284 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:36,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a8aa727465990a4c1757637501c6bfc, ASSIGN}] 2023-07-24 13:07:36,352 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a8aa727465990a4c1757637501c6bfc, ASSIGN 2023-07-24 13:07:36,353 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a8aa727465990a4c1757637501c6bfc, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,43049,1690203972978; forceNewPlan=false, retain=false 2023-07-24 13:07:36,503 INFO [jenkins-hbase4:42065] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 13:07:36,505 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2a8aa727465990a4c1757637501c6bfc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:36,506 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690204056505"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204056505"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204056505"}]},"ts":"1690204056505"} 2023-07-24 13:07:36,509 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 2a8aa727465990a4c1757637501c6bfc, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:07:36,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 13:07:36,664 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. 2023-07-24 13:07:36,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2a8aa727465990a4c1757637501c6bfc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.', STARTKEY => '', ENDKEY => ''} 2023-07-24 13:07:36,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. service=AccessControlService 2023-07-24 13:07:36,665 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:36,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:36,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:36,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:36,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:36,666 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/.regioninfo 2023-07-24 13:07:36,677 INFO [StoreOpener-2a8aa727465990a4c1757637501c6bfc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:36,679 DEBUG [StoreOpener-2a8aa727465990a4c1757637501c6bfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf 2023-07-24 13:07:36,679 DEBUG [StoreOpener-2a8aa727465990a4c1757637501c6bfc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf 2023-07-24 13:07:36,679 INFO [StoreOpener-2a8aa727465990a4c1757637501c6bfc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2a8aa727465990a4c1757637501c6bfc columnFamilyName cf 2023-07-24 13:07:36,708 DEBUG [StoreOpener-2a8aa727465990a4c1757637501c6bfc-1] regionserver.HStore(539): loaded hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf/19dfc800d2084d4bb5a1ee4b72593fad.5d5c6f22157290f5731d12fb38908d6c->hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/cf/19dfc800d2084d4bb5a1ee4b72593fad-top 2023-07-24 13:07:36,714 DEBUG [StoreOpener-2a8aa727465990a4c1757637501c6bfc-1] regionserver.HStore(539): loaded hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf/2b88118df15b4978bfec91ffbc5efe55.a3e64dd7d91d921c059a2da5bccc516f->hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/cf/2b88118df15b4978bfec91ffbc5efe55-top 2023-07-24 13:07:36,715 INFO [StoreOpener-2a8aa727465990a4c1757637501c6bfc-1] regionserver.HStore(310): Store=2a8aa727465990a4c1757637501c6bfc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:36,716 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:36,717 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:36,721 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:36,722 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2a8aa727465990a4c1757637501c6bfc; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71610151, jitterRate=0.06707440316677094}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:36,722 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2a8aa727465990a4c1757637501c6bfc: 2023-07-24 13:07:36,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc., pid=77, masterSystemTime=1690204056661 2023-07-24 13:07:36,723 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.,because compaction is disabled. 2023-07-24 13:07:36,725 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. 2023-07-24 13:07:36,725 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. 2023-07-24 13:07:36,726 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=2a8aa727465990a4c1757637501c6bfc, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:36,726 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690204056725"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204056725"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204056725"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204056725"}]},"ts":"1690204056725"} 2023-07-24 13:07:36,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 13:07:36,729 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 2a8aa727465990a4c1757637501c6bfc, server=jenkins-hbase4.apache.org,43049,1690203972978 in 219 msec 2023-07-24 13:07:36,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 13:07:36,731 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a8aa727465990a4c1757637501c6bfc, ASSIGN in 378 msec 2023-07-24 13:07:36,733 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[5d5c6f22157290f5731d12fb38908d6c, a3e64dd7d91d921c059a2da5bccc516f], force=true in 768 msec 2023-07-24 13:07:37,015 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0004_000001 (auth:SIMPLE) 2023-07-24 13:07:37,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 13:07:37,081 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 13:07:37,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 13:07:37,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204057082 (current time:1690204057082). 2023-07-24 13:07:37,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:37,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x201e6972 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:37,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bbbb193, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:37,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:37,093 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32830, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:37,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x201e6972 to 127.0.0.1:59137 2023-07-24 13:07:37,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:37,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x72e2fbb7 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:37,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@21644960, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:37,107 DEBUG [hconnection-0x7f553f6-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:37,113 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32846, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:37,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:37,125 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:37,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72e2fbb7 to 127.0.0.1:59137 2023-07-24 13:07:37,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:37,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 13:07:37,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:37,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 13:07:37,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 13:07:37,145 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 13:07:37,148 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690204657148 2023-07-24 13:07:37,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 13:07:37,148 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,155 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:37,155 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:37,156 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 13:07:37,157 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 13:07:37,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 27 msec 2023-07-24 13:07:37,162 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 13:07:37,167 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690204657167 2023-07-24 13:07:37,188 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,188 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 13:07:37,188 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:37,190 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 13:07:37,190 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 13:07:37,191 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,191 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,193 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:37,193 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,193 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:37,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:37,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:37,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:37,193 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:37,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:37,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:37,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:37,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,194 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,194 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:37,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,194 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 13:07:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 13:07:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,195 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 13:07:37,195 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 13:07:37,196 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 13:07:37,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,197 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 13:07:37,198 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,199 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 13:07:37,199 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:37,201 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 13:07:37,201 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 13:07:37,201 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 13:07:37,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,201 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,201 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 13:07:37,201 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 13:07:37,201 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:37,201 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:37,203 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,203 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,203 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:37,205 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 13:07:37,205 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 13:07:37,205 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 13:07:37,205 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 13:07:37,205 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 13:07:37,205 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 13:07:37,208 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,208 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:37,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:37,209 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:37,209 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,209 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:37,209 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,209 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:37,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:37,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,211 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:37,211 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 13:07:37,212 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1720d8c1[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:37,212 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 13:07:37,212 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,213 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,213 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,213 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,213 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,214 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,213 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,214 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 13:07:37,214 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 13:07:37,214 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,214 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 13:07:37,214 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 13:07:37,214 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:07:37,214 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:37,214 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 13:07:37,215 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:37,215 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:37,215 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. 2023-07-24 13:07:37,215 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:07:37,215 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. started... 2023-07-24 13:07:37,217 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 2a8aa727465990a4c1757637501c6bfc: 2023-07-24 13:07:37,217 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,217 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:37,218 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 13:07:37,218 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:37,218 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 13:07:37,218 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf/19dfc800d2084d4bb5a1ee4b72593fad.5d5c6f22157290f5731d12fb38908d6c->hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/cf/19dfc800d2084d4bb5a1ee4b72593fad-top, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf/2b88118df15b4978bfec91ffbc5efe55.a3e64dd7d91d921c059a2da5bccc516f->hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/cf/2b88118df15b4978bfec91ffbc5efe55-top] hfiles 2023-07-24 13:07:37,219 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf/19dfc800d2084d4bb5a1ee4b72593fad.5d5c6f22157290f5731d12fb38908d6c for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,220 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf/2b88118df15b4978bfec91ffbc5efe55.a3e64dd7d91d921c059a2da5bccc516f for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,220 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 13:07:37,221 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:37,221 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 13:07:37,237 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. completed. 2023-07-24 13:07:37,238 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. 2023-07-24 13:07:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 13:07:37,238 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:07:37,248 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,248 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 13:07:37,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:37,248 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:37,248 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:37,248 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 13:07:37,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:37,249 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:37,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:37,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:37,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:37,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:37,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:37,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:07:37,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 13:07:37,255 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 13:07:37,255 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:37,255 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:37,255 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,255 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:37,255 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:37,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 13:07:37,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:37,257 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,257 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,257 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,257 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,257 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:37,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,257 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:37,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:37,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:37,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,257 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:37,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,257 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:37,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:37,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:37,258 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:37,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:37,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:37,262 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,263 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,263 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:37,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,265 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:37,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:37,266 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:37,266 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:37,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,271 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:37,271 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:37,271 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,271 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,271 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:37,271 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:37,271 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:37,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:37,271 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:37,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:37,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:37,272 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,272 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:37,272 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:37,272 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:37,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:37,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:37,273 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:37,273 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,273 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,273 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:37,273 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,273 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,274 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:37,274 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:37,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:37,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:37,275 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-24 13:07:37,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:37,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:37,312 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,345 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 13:07:37,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,345 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,345 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690204057149Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690204057273 (+124 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690204057273Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690204057278 (+5 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690204057300 (+22 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690204057345 (+45 ms) 2023-07-24 13:07:37,349 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 13:07:37,350 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 194 msec 2023-07-24 13:07:37,458 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:37,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 13:07:37,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:37,459 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204057459 2023-07-24 13:07:37,459 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35185, tgtDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204057459, rawTgtDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204057459, srcFsUri=hdfs://localhost:35185, srcDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:07:37,489 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:07:37,489 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_343789751_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204057459, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204057459/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,489 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83, snapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 13:07:37,499 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204057459/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:37,572 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:37,573 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:37,573 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:37,574 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:38,316 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:07:38,669 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-7351832443077184981.jar 2023-07-24 13:07:38,669 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:38,670 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:38,746 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-5478193335681145281.jar 2023-07-24 13:07:38,747 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:38,747 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:38,748 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:38,748 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:38,748 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:38,749 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:38,749 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:07:38,750 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:07:38,750 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:07:38,750 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:07:38,751 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:07:38,751 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:07:38,752 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:07:38,752 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:07:38,752 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:07:38,753 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:07:38,754 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:38,754 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:38,755 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:38,755 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:38,756 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:38,756 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:38,757 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:39,571 WARN [Listener at jenkins-hbase4.apache.org/43547] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:07:39,575 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 13:07:39,577 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 13:07:39,733 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:39,733 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:39,910 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0005_000001 (auth:SIMPLE) 2023-07-24 13:07:45,777 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0005_000001 (auth:SIMPLE) 2023-07-24 13:07:48,200 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0005_000001 (auth:SIMPLE) 2023-07-24 13:07:52,481 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0005_000001 (auth:SIMPLE) 2023-07-24 13:07:53,915 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:07:53,926 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:07:53,941 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:53,942 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:07:53,942 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:07:53,942 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:53,949 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 13:07:53,949 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 13:07:53,949 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204057459/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204057459/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:53,951 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204057459/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 13:07:53,951 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204057459/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 13:07:53,983 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:53,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:53,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:53,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 13:07:53,990 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204073990"}]},"ts":"1690204073990"} 2023-07-24 13:07:53,994 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 13:07:53,996 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 13:07:53,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a8aa727465990a4c1757637501c6bfc, UNASSIGN}] 2023-07-24 13:07:54,000 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a8aa727465990a4c1757637501c6bfc, UNASSIGN 2023-07-24 13:07:54,002 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2a8aa727465990a4c1757637501c6bfc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:54,002 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690204074002"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204074002"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204074002"}]},"ts":"1690204074002"} 2023-07-24 13:07:54,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 2a8aa727465990a4c1757637501c6bfc, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:07:54,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 13:07:54,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:54,158 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2a8aa727465990a4c1757637501c6bfc, disabling compactions & flushes 2023-07-24 13:07:54,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. 2023-07-24 13:07:54,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. 2023-07-24 13:07:54,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. after waiting 0 ms 2023-07-24 13:07:54,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. 2023-07-24 13:07:54,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 13:07:54,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:54,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc. 2023-07-24 13:07:54,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2a8aa727465990a4c1757637501c6bfc: 2023-07-24 13:07:54,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:54,182 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=2a8aa727465990a4c1757637501c6bfc, regionState=CLOSED 2023-07-24 13:07:54,182 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690204074182"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204074182"}]},"ts":"1690204074182"} 2023-07-24 13:07:54,187 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 13:07:54,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 2a8aa727465990a4c1757637501c6bfc, server=jenkins-hbase4.apache.org,43049,1690203972978 in 177 msec 2023-07-24 13:07:54,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 13:07:54,190 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=2a8aa727465990a4c1757637501c6bfc, UNASSIGN in 191 msec 2023-07-24 13:07:54,195 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204074195"}]},"ts":"1690204074195"} 2023-07-24 13:07:54,199 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 13:07:54,203 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 13:07:54,205 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 220 msec 2023-07-24 13:07:54,293 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 13:07:54,294 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 13:07:54,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,299 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,301 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,304 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,307 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,307 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,307 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,307 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 13:07:54,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 13:07:54,308 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 13:07:54,309 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,309 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:54,309 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data null 2023-07-24 13:07:54,309 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,309 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:54,309 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,309 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:54,309 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:54,309 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 13:07:54,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 13:07:54,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:54,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:54,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:54,311 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:54,313 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:54,314 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:54,314 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:54,323 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/recovered.edits] 2023-07-24 13:07:54,323 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/recovered.edits] 2023-07-24 13:07:54,323 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/recovered.edits] 2023-07-24 13:07:54,329 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/cf/2b88118df15b4978bfec91ffbc5efe55 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/cf/2b88118df15b4978bfec91ffbc5efe55 2023-07-24 13:07:54,332 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/cf/19dfc800d2084d4bb5a1ee4b72593fad to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/cf/19dfc800d2084d4bb5a1ee4b72593fad 2023-07-24 13:07:54,334 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf/19dfc800d2084d4bb5a1ee4b72593fad.5d5c6f22157290f5731d12fb38908d6c to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf/19dfc800d2084d4bb5a1ee4b72593fad.5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:54,337 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/recovered.edits/8.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f/recovered.edits/8.seqid 2023-07-24 13:07:54,338 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:54,338 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf/2b88118df15b4978bfec91ffbc5efe55.a3e64dd7d91d921c059a2da5bccc516f to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/cf/2b88118df15b4978bfec91ffbc5efe55.a3e64dd7d91d921c059a2da5bccc516f 2023-07-24 13:07:54,341 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/recovered.edits/8.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c/recovered.edits/8.seqid 2023-07-24 13:07:54,351 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/5d5c6f22157290f5731d12fb38908d6c 2023-07-24 13:07:54,355 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/recovered.edits/12.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc/recovered.edits/12.seqid 2023-07-24 13:07:54,356 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/2a8aa727465990a4c1757637501c6bfc 2023-07-24 13:07:54,356 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 13:07:54,359 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,374 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 13:07:54,376 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 13:07:54,378 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,378 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 13:07:54,378 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204074378"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:54,382 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 13:07:54,383 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 2a8aa727465990a4c1757637501c6bfc, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690204055316.2a8aa727465990a4c1757637501c6bfc.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 13:07:54,383 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 13:07:54,383 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204074383"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:54,385 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 13:07:54,389 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 94 msec 2023-07-24 13:07:54,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 13:07:54,412 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 13:07:54,413 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,413 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,419 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204074419"}]},"ts":"1690204074419"} 2023-07-24 13:07:54,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 13:07:54,421 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 13:07:54,423 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 13:07:54,424 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=16f6f35cec9ff7096a734992da0a3031, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a317e96b718ebbdd3faa95d2e92f604, UNASSIGN}] 2023-07-24 13:07:54,425 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a317e96b718ebbdd3faa95d2e92f604, UNASSIGN 2023-07-24 13:07:54,427 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=16f6f35cec9ff7096a734992da0a3031, UNASSIGN 2023-07-24 13:07:54,428 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=16f6f35cec9ff7096a734992da0a3031, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:54,429 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204074428"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204074428"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204074428"}]},"ts":"1690204074428"} 2023-07-24 13:07:54,430 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=9a317e96b718ebbdd3faa95d2e92f604, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:54,430 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204074430"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204074430"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204074430"}]},"ts":"1690204074430"} 2023-07-24 13:07:54,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 16f6f35cec9ff7096a734992da0a3031, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:07:54,447 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 9a317e96b718ebbdd3faa95d2e92f604, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:07:54,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 13:07:54,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:54,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 16f6f35cec9ff7096a734992da0a3031, disabling compactions & flushes 2023-07-24 13:07:54,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:54,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:54,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. after waiting 0 ms 2023-07-24 13:07:54,599 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:54,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:54,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9a317e96b718ebbdd3faa95d2e92f604, disabling compactions & flushes 2023-07-24 13:07:54,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:54,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:54,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. after waiting 0 ms 2023-07-24 13:07:54,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:54,646 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:07:54,647 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:54,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:07:54,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604. 2023-07-24 13:07:54,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9a317e96b718ebbdd3faa95d2e92f604: 2023-07-24 13:07:54,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:07:54,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031. 2023-07-24 13:07:54,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 16f6f35cec9ff7096a734992da0a3031: 2023-07-24 13:07:54,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:54,653 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=9a317e96b718ebbdd3faa95d2e92f604, regionState=CLOSED 2023-07-24 13:07:54,653 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204074653"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204074653"}]},"ts":"1690204074653"} 2023-07-24 13:07:54,654 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:54,654 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=16f6f35cec9ff7096a734992da0a3031, regionState=CLOSED 2023-07-24 13:07:54,655 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690204074654"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204074654"}]},"ts":"1690204074654"} 2023-07-24 13:07:54,667 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-24 13:07:54,669 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 9a317e96b718ebbdd3faa95d2e92f604, server=jenkins-hbase4.apache.org,43049,1690203972978 in 217 msec 2023-07-24 13:07:54,669 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=9a317e96b718ebbdd3faa95d2e92f604, UNASSIGN in 243 msec 2023-07-24 13:07:54,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-24 13:07:54,682 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 16f6f35cec9ff7096a734992da0a3031, server=jenkins-hbase4.apache.org,36751,1690203972794 in 219 msec 2023-07-24 13:07:54,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=85, resume processing ppid=84 2023-07-24 13:07:54,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=16f6f35cec9ff7096a734992da0a3031, UNASSIGN in 258 msec 2023-07-24 13:07:54,686 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204074686"}]},"ts":"1690204074686"} 2023-07-24 13:07:54,688 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 13:07:54,689 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 13:07:54,692 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 277 msec 2023-07-24 13:07:54,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 13:07:54,724 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 13:07:54,724 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,731 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,732 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,734 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,737 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:54,738 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:54,739 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,740 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 13:07:54,740 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,740 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,740 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,741 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 13:07:54,742 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/recovered.edits] 2023-07-24 13:07:54,743 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/recovered.edits] 2023-07-24 13:07:54,747 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 13:07:54,748 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 13:07:54,749 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,749 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:54,749 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,749 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:54,749 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,749 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:54,751 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/cf/73ea16b93a8a4d188ed965c29ba7ce30 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/cf/73ea16b93a8a4d188ed965c29ba7ce30 2023-07-24 13:07:54,751 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,751 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:54,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 13:07:54,755 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031/recovered.edits/9.seqid 2023-07-24 13:07:54,756 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/16f6f35cec9ff7096a734992da0a3031 2023-07-24 13:07:54,758 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/cf/4970aba692164a61a5e8e44f63c40e47 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/cf/4970aba692164a61a5e8e44f63c40e47 2023-07-24 13:07:54,762 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604/recovered.edits/9.seqid 2023-07-24 13:07:54,762 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/9a317e96b718ebbdd3faa95d2e92f604 2023-07-24 13:07:54,762 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 13:07:54,766 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,771 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 13:07:54,776 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 13:07:54,778 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,778 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 13:07:54,779 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204074778"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:54,779 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204074778"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:54,787 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:07:54,788 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 16f6f35cec9ff7096a734992da0a3031, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690204053235.16f6f35cec9ff7096a734992da0a3031.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 9a317e96b718ebbdd3faa95d2e92f604, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690204053235.9a317e96b718ebbdd3faa95d2e92f604.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:07:54,788 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 13:07:54,788 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204074788"}]},"ts":"9223372036854775807"} 2023-07-24 13:07:54,790 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 13:07:54,793 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 68 msec 2023-07-24 13:07:54,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 13:07:54,854 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 13:07:54,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 13:07:54,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,876 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 13:07:54,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 13:07:54,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 13:07:54,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 13:07:54,921 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=761 (was 747) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-32 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-30 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1630161891_1 at /127.0.0.1:35042 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-29 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:53084 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1630161891_1 at /127.0.0.1:53070 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:37183 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-3829 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-31 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:60330 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:35070 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=905 (was 891) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=503 (was 383) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=5174 (was 5717) 2023-07-24 13:07:54,922 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 13:07:54,950 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=761, OpenFileDescriptor=905, MaxFileDescriptor=60000, SystemLoadAverage=503, ProcessCount=184, AvailableMemoryMB=5172 2023-07-24 13:07:54,951 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=761 is superior to 500 2023-07-24 13:07:54,953 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 13:07:54,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:07:54,965 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:07:54,967 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:07:54,971 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 13:07:54,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 13:07:54,974 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:07:54,974 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:07:54,976 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb empty. 2023-07-24 13:07:54,976 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363 empty. 2023-07-24 13:07:54,978 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:07:54,979 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:07:54,979 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 13:07:55,004 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 13:07:55,006 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 5b4ea3b77af3c73ebe93d293f7384363, NAME => 'testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:07:55,006 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3b01550eba8bd5058ef5e4caa2cab9eb, NAME => 'testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:07:55,052 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:55,052 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 5b4ea3b77af3c73ebe93d293f7384363, disabling compactions & flushes 2023-07-24 13:07:55,053 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:55,053 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:55,053 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. after waiting 0 ms 2023-07-24 13:07:55,053 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:55,053 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:55,053 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 5b4ea3b77af3c73ebe93d293f7384363: 2023-07-24 13:07:55,054 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:55,055 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 3b01550eba8bd5058ef5e4caa2cab9eb, disabling compactions & flushes 2023-07-24 13:07:55,055 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:55,055 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:55,055 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. after waiting 0 ms 2023-07-24 13:07:55,055 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:55,055 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:55,055 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 3b01550eba8bd5058ef5e4caa2cab9eb: 2023-07-24 13:07:55,057 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:07:55,058 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204075058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204075058"}]},"ts":"1690204075058"} 2023-07-24 13:07:55,058 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204075058"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204075058"}]},"ts":"1690204075058"} 2023-07-24 13:07:55,065 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:07:55,065 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:07:55,065 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204075065"}]},"ts":"1690204075065"} 2023-07-24 13:07:55,067 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 13:07:55,073 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:07:55,075 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:07:55,075 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:07:55,075 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:07:55,075 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:07:55,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3b01550eba8bd5058ef5e4caa2cab9eb, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b4ea3b77af3c73ebe93d293f7384363, ASSIGN}] 2023-07-24 13:07:55,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 13:07:55,082 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b4ea3b77af3c73ebe93d293f7384363, ASSIGN 2023-07-24 13:07:55,082 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3b01550eba8bd5058ef5e4caa2cab9eb, ASSIGN 2023-07-24 13:07:55,083 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3b01550eba8bd5058ef5e4caa2cab9eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43049,1690203972978; forceNewPlan=false, retain=false 2023-07-24 13:07:55,083 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b4ea3b77af3c73ebe93d293f7384363, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36751,1690203972794; forceNewPlan=false, retain=false 2023-07-24 13:07:55,233 INFO [jenkins-hbase4:42065] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:07:55,236 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3b01550eba8bd5058ef5e4caa2cab9eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,236 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=5b4ea3b77af3c73ebe93d293f7384363, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:55,236 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204075236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204075236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204075236"}]},"ts":"1690204075236"} 2023-07-24 13:07:55,236 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204075236"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204075236"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204075236"}]},"ts":"1690204075236"} 2023-07-24 13:07:55,238 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=92, state=RUNNABLE; OpenRegionProcedure 5b4ea3b77af3c73ebe93d293f7384363, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:07:55,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=91, state=RUNNABLE; OpenRegionProcedure 3b01550eba8bd5058ef5e4caa2cab9eb, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:07:55,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 13:07:55,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:55,400 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5b4ea3b77af3c73ebe93d293f7384363, NAME => 'testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:07:55,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. service=AccessControlService 2023-07-24 13:07:55,401 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:55,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:07:55,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:55,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:07:55,401 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:07:55,402 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:55,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3b01550eba8bd5058ef5e4caa2cab9eb, NAME => 'testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:07:55,403 INFO [StoreOpener-5b4ea3b77af3c73ebe93d293f7384363-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:07:55,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. service=AccessControlService 2023-07-24 13:07:55,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:07:55,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:07:55,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:07:55,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:07:55,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:07:55,405 DEBUG [StoreOpener-5b4ea3b77af3c73ebe93d293f7384363-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/cf 2023-07-24 13:07:55,405 DEBUG [StoreOpener-5b4ea3b77af3c73ebe93d293f7384363-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/cf 2023-07-24 13:07:55,405 INFO [StoreOpener-3b01550eba8bd5058ef5e4caa2cab9eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:07:55,405 INFO [StoreOpener-5b4ea3b77af3c73ebe93d293f7384363-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5b4ea3b77af3c73ebe93d293f7384363 columnFamilyName cf 2023-07-24 13:07:55,407 INFO [StoreOpener-5b4ea3b77af3c73ebe93d293f7384363-1] regionserver.HStore(310): Store=5b4ea3b77af3c73ebe93d293f7384363/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:55,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:07:55,410 DEBUG [StoreOpener-3b01550eba8bd5058ef5e4caa2cab9eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/cf 2023-07-24 13:07:55,410 DEBUG [StoreOpener-3b01550eba8bd5058ef5e4caa2cab9eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/cf 2023-07-24 13:07:55,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:07:55,411 INFO [StoreOpener-3b01550eba8bd5058ef5e4caa2cab9eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b01550eba8bd5058ef5e4caa2cab9eb columnFamilyName cf 2023-07-24 13:07:55,411 INFO [StoreOpener-3b01550eba8bd5058ef5e4caa2cab9eb-1] regionserver.HStore(310): Store=3b01550eba8bd5058ef5e4caa2cab9eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:07:55,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:07:55,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:07:55,414 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:07:55,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:07:55,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:55,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:07:55,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5b4ea3b77af3c73ebe93d293f7384363; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70093107, jitterRate=0.04446868598461151}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:55,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5b4ea3b77af3c73ebe93d293f7384363: 2023-07-24 13:07:55,433 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3b01550eba8bd5058ef5e4caa2cab9eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62437214, jitterRate=-0.0696130096912384}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:07:55,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3b01550eba8bd5058ef5e4caa2cab9eb: 2023-07-24 13:07:55,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363., pid=93, masterSystemTime=1690204075390 2023-07-24 13:07:55,434 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb., pid=94, masterSystemTime=1690204075391 2023-07-24 13:07:55,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:55,436 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:55,436 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=5b4ea3b77af3c73ebe93d293f7384363, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:55,437 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204075436"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204075436"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204075436"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204075436"}]},"ts":"1690204075436"} 2023-07-24 13:07:55,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:55,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:55,437 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=3b01550eba8bd5058ef5e4caa2cab9eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,438 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204075437"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204075437"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204075437"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204075437"}]},"ts":"1690204075437"} 2023-07-24 13:07:55,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=92 2023-07-24 13:07:55,440 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=92, state=SUCCESS; OpenRegionProcedure 5b4ea3b77af3c73ebe93d293f7384363, server=jenkins-hbase4.apache.org,36751,1690203972794 in 200 msec 2023-07-24 13:07:55,441 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b4ea3b77af3c73ebe93d293f7384363, ASSIGN in 364 msec 2023-07-24 13:07:55,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=91 2023-07-24 13:07:55,444 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=91, state=SUCCESS; OpenRegionProcedure 3b01550eba8bd5058ef5e4caa2cab9eb, server=jenkins-hbase4.apache.org,43049,1690203972978 in 201 msec 2023-07-24 13:07:55,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-24 13:07:55,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3b01550eba8bd5058ef5e4caa2cab9eb, ASSIGN in 368 msec 2023-07-24 13:07:55,446 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:07:55,447 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204075447"}]},"ts":"1690204075447"} 2023-07-24 13:07:55,448 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 13:07:55,450 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:07:55,451 DEBUG [PEWorker-3] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 13:07:55,452 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:07:55,454 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:55,454 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:55,454 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:55,454 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:07:55,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:55,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:55,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:55,455 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 13:07:55,457 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 502 msec 2023-07-24 13:07:55,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 13:07:55,583 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 13:07:55,583 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testEmptyExportFileSystemState get assigned. Timeout = 60000ms 2023-07-24 13:07:55,583 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:55,593 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3484): All regions for table testtb-testEmptyExportFileSystemState assigned to meta. Checking AM states. 2023-07-24 13:07:55,593 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:55,593 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3504): All regions for table testtb-testEmptyExportFileSystemState assigned. 2023-07-24 13:07:55,597 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:07:55,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204075597 (current time:1690204075597). 2023-07-24 13:07:55,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:55,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x08f2d527 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:55,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60b31eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:55,634 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:55,638 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41418, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:55,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x08f2d527 to 127.0.0.1:59137 2023-07-24 13:07:55,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:55,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x191472e5 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:55,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@751d70d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:55,663 DEBUG [hconnection-0x580a2a65-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:55,667 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:55,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:55,675 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58430, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:55,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x191472e5 to 127.0.0.1:59137 2023-07-24 13:07:55,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:55,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:07:55,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:55,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:07:55,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:07:55,685 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:07:55,687 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690204675687 2023-07-24 13:07:55,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:07:55,687 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 13:07:55,689 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:55,689 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:55,690 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:07:55,691 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:07:55,693 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-24 13:07:55,697 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:07:55,698 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690204675698 2023-07-24 13:07:55,727 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,727 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 13:07:55,727 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:55,729 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 13:07:55,729 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 13:07:55,730 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,730 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,740 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:55,740 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,740 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:55,740 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:55,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:55,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:55,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:55,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:55,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:55,741 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,741 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,741 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,741 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:55,742 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 13:07:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,742 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:07:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 13:07:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,743 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:07:55,743 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 13:07:55,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,744 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:07:55,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,746 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,747 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:07:55,747 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:07:55,747 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:55,747 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:07:55,752 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:07:55,747 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:07:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:07:55,753 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:07:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:55,756 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:07:55,764 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:07:55,764 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:07:55,764 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:07:55,764 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:07:55,765 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:55,765 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:55,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:55,766 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,766 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,768 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,768 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:55,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:55,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:55,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:55,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 13:07:55,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c4e7927[Count = 1] remaining members to acquire global barrier 2023-07-24 13:07:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:55,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:55,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:55,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:55,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 13:07:55,778 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c4e7927[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:55,778 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 13:07:55,779 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,780 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,780 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,780 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:07:55,780 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:55,780 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,781 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:07:55,781 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:07:55,781 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:07:55,781 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,781 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:07:55,782 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:55,783 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:55,783 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:55,783 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. started... 2023-07-24 13:07:55,785 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3b01550eba8bd5058ef5e4caa2cab9eb: 2023-07-24 13:07:55,785 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,785 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:55,785 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:07:55,788 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,789 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:07:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:55,789 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:55,789 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:55,789 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. started... 2023-07-24 13:07:55,790 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:55,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:07:55,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:55,793 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b4ea3b77af3c73ebe93d293f7384363: 2023-07-24 13:07:55,793 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,793 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:55,793 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:07:55,793 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:55,831 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. completed. 2023-07-24 13:07:55,831 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:55,831 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:55,831 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:55,831 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,831 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:07:55,831 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:07:55,836 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:07:55,836 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,836 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:55,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,836 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:55,836 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:07:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:55,838 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:55,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:55,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:55,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:55,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:55,841 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:55,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:07:55,842 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 13:07:55,993 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:55,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:07:55,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:55,995 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:07:56,238 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. completed. 2023-07-24 13:07:56,239 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:56,239 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:56,239 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:56,239 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,239 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:07:56,239 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:07:56,240 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:07:56,240 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,240 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:56,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:56,240 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:07:56,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:56,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:56,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,246 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,247 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36751,1690203972794': 2023-07-24 13:07:56,247 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 13:07:56,247 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 13:07:56,247 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:56,247 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:56,247 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,247 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:56,250 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,250 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:56,250 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,250 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,250 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:56,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,250 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:56,250 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:56,250 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:56,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:56,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,251 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:56,251 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:56,251 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:56,251 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:56,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:56,254 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,254 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:56,255 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,258 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,258 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,258 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,258 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:56,258 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:56,258 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:56,258 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:56,258 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:56,258 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:56,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:56,258 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:56,258 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:56,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:56,258 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:56,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:56,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:56,258 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:56,260 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,260 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,260 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,260 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,260 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:56,261 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,261 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:56,260 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:56,261 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,280 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,295 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:56,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:07:56,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:56,296 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 13:07:56,306 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 13:07:56,306 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,307 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,307 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690204075687Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690204076258 (+571 ms)Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690204076260 (+2 ms)Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690204076265 (+5 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690204076274 (+9 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690204076306 (+32 ms) 2023-07-24 13:07:56,310 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:07:56,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 621 msec 2023-07-24 13:07:56,797 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:56,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:07:56,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:56,804 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:07:56,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36751] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:07:56,807 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 13:07:56,807 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:56,808 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:07:56,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:07:56,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204076821 (current time:1690204076821). 2023-07-24 13:07:56,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:07:56,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x5e12df76 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:56,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@57429fd3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:56,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:56,839 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:56,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e12df76 to 127.0.0.1:59137 2023-07-24 13:07:56,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:56,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x232f6459 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:07:56,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b8ee625, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:07:56,852 DEBUG [hconnection-0x28f15080-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:56,854 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:41428, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:56,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:07:56,858 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58434, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:07:56,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x232f6459 to 127.0.0.1:59137 2023-07-24 13:07:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:07:56,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 13:07:56,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:07:56,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:07:56,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:07:56,867 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:07:56,868 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690204676868 2023-07-24 13:07:56,868 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 13:07:56,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 13:07:56,870 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:07:56,870 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:07:56,871 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:07:56,872 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 13:07:56,876 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 7 msec 2023-07-24 13:07:56,877 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:07:56,878 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690204676878 2023-07-24 13:07:56,889 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,889 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 13:07:56,889 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:56,891 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 13:07:56,891 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 13:07:56,967 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,967 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,968 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:56,968 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:56,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:56,968 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:56,968 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:56,968 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,969 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:56,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:56,969 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,969 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,969 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,969 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,969 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,969 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:07:56,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,970 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 13:07:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,970 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 13:07:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,970 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:07:56,970 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 13:07:56,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,971 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:07:56,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,971 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:07:56,971 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:56,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:07:56,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:07:56,972 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:07:56,970 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 13:07:56,971 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,975 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:07:56,975 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:56,977 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,976 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 13:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:07:56,978 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:07:56,982 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 13:07:56,983 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 13:07:56,982 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:07:56,983 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 13:07:56,987 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,987 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:56,987 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:56,988 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,988 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:56,988 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,988 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:56,988 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,988 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:56,989 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:56,989 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,989 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:07:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:56,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:56,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 13:07:56,991 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@603ce624[Count = 1] remaining members to acquire global barrier 2023-07-24 13:07:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:56,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:56,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:56,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:56,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 13:07:56,994 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@603ce624[Count = 0] remaining members to acquire global barrier 2023-07-24 13:07:56,994 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 13:07:56,994 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,998 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,998 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,998 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:56,998 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:07:56,998 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:07:56,999 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:07:56,999 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:07:56,999 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:56,999 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:56,999 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:56,999 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:56,999 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. started... 2023-07-24 13:07:56,999 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:56,999 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:07:56,999 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 5b4ea3b77af3c73ebe93d293f7384363 1/1 column families, dataSize=3.00 KB heapSize=6.72 KB 2023-07-24 13:07:57,000 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,000 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 13:07:57,000 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:07:57,001 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:07:57,001 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:57,001 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. started... 2023-07-24 13:07:57,001 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 3b01550eba8bd5058ef5e4caa2cab9eb 1/1 column families, dataSize=266 B heapSize=832 B 2023-07-24 13:07:57,001 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:07:57,001 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:57,001 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:07:57,019 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=266 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/.tmp/cf/be376fa87b6c4fb09f02e931d8f19d28 2023-07-24 13:07:57,023 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.00 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/.tmp/cf/599f8efd15de46aeb443b250190a1438 2023-07-24 13:07:57,029 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/.tmp/cf/be376fa87b6c4fb09f02e931d8f19d28 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/cf/be376fa87b6c4fb09f02e931d8f19d28 2023-07-24 13:07:57,029 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/.tmp/cf/599f8efd15de46aeb443b250190a1438 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/cf/599f8efd15de46aeb443b250190a1438 2023-07-24 13:07:57,034 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/cf/be376fa87b6c4fb09f02e931d8f19d28, entries=4, sequenceid=6, filesize=5.1 K 2023-07-24 13:07:57,034 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/cf/599f8efd15de46aeb443b250190a1438, entries=46, sequenceid=6, filesize=7.9 K 2023-07-24 13:07:57,035 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~266 B/266, heapSize ~816 B/816, currentSize=0 B/0 for 3b01550eba8bd5058ef5e4caa2cab9eb in 34ms, sequenceid=6, compaction requested=false 2023-07-24 13:07:57,035 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 13:07:57,036 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.00 KB/3070, heapSize ~6.70 KB/6864, currentSize=0 B/0 for 5b4ea3b77af3c73ebe93d293f7384363 in 37ms, sequenceid=6, compaction requested=false 2023-07-24 13:07:57,037 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 3b01550eba8bd5058ef5e4caa2cab9eb: 2023-07-24 13:07:57,037 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 5b4ea3b77af3c73ebe93d293f7384363: 2023-07-24 13:07:57,037 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,038 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,038 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:57,038 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:07:57,038 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/cf/be376fa87b6c4fb09f02e931d8f19d28] hfiles 2023-07-24 13:07:57,038 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/cf/599f8efd15de46aeb443b250190a1438] hfiles 2023-07-24 13:07:57,038 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/cf/be376fa87b6c4fb09f02e931d8f19d28 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,038 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/cf/599f8efd15de46aeb443b250190a1438 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,056 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. completed. 2023-07-24 13:07:57,056 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:07:57,056 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:07:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:07:57,057 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. completed. 2023-07-24 13:07:57,057 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:07:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:07:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:07:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 13:07:57,057 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:07:57,058 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:07:57,058 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,058 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:57,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:57,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:57,058 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:07:57,060 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 13:07:57,061 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:57,061 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,061 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 13:07:57,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:57,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:57,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:57,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:57,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:57,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,36751,1690203972794': 2023-07-24 13:07:57,066 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 13:07:57,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:57,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:57,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:57,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:57,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:57,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:57,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:57,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:07:57,069 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 13:07:57,069 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 13:07:57,070 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:07:57,070 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:07:57,070 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,070 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:07:57,071 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,071 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,072 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,072 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:57,072 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:57,072 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,071 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,072 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:57,071 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,072 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:57,073 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:07:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,074 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,075 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:07:57,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:57,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,077 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:57,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:07:57,077 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,077 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:57,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,080 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,080 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,080 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:57,080 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:57,080 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:57,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:57,080 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:57,080 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:57,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:57,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:57,080 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:57,080 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,080 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:57,080 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:07:57,080 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:57,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:07:57,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:07:57,083 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:07:57,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:57,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:57,082 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:07:57,083 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,083 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:07:57,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:07:57,083 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:07:57,083 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:07:57,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:07:57,133 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,165 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 13:07:57,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,165 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,165 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690204076868Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690204077080 (+212 ms)Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690204077081 (+1 ms)Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690204077097 (+16 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690204077119 (+22 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690204077165 (+46 ms) 2023-07-24 13:07:57,172 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:07:57,172 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 13:07:57,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 303 msec 2023-07-24 13:07:57,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 13:07:57,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:07:57,176 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204077176 2023-07-24 13:07:57,177 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35185, tgtDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204077176, rawTgtDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204077176, srcFsUri=hdfs://localhost:35185, srcDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:07:57,200 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:07:57,200 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_244113237_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204077176, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204077176/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,200 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83, snapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 13:07:57,207 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204077176/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:07:57,253 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:57,253 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:57,254 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:57,255 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:58,333 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-7223709732647367682.jar 2023-07-24 13:07:58,333 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:58,334 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:58,416 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-115375239118141395.jar 2023-07-24 13:07:58,416 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:58,417 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:58,417 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:58,418 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:58,419 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:58,419 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:07:58,420 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:07:58,420 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:07:58,421 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:07:58,421 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:07:58,422 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:07:58,423 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:07:58,423 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:07:58,423 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:07:58,424 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:07:58,424 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:07:58,425 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:58,426 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:58,426 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:58,427 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:58,427 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:07:58,428 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:58,428 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:07:58,619 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0005_000001 (auth:SIMPLE) 2023-07-24 13:07:59,552 WARN [Listener at jenkins-hbase4.apache.org/43547] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:07:59,555 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 13:07:59,696 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:59,696 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:07:59,848 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:08:00,055 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0006_000001 (auth:SIMPLE) 2023-07-24 13:08:05,787 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0006_000001 (auth:SIMPLE) 2023-07-24 13:08:09,055 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:08:09,056 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:08:09,063 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:09,063 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:08:09,064 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:08:09,064 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:09,065 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 13:08:09,065 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 13:08:09,065 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204077176/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204077176/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:09,066 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204077176/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 13:08:09,066 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204077176/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 13:08:09,076 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,076 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 13:08:09,082 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204089082"}]},"ts":"1690204089082"} 2023-07-24 13:08:09,084 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 13:08:09,086 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 13:08:09,095 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3b01550eba8bd5058ef5e4caa2cab9eb, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b4ea3b77af3c73ebe93d293f7384363, UNASSIGN}] 2023-07-24 13:08:09,099 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3b01550eba8bd5058ef5e4caa2cab9eb, UNASSIGN 2023-07-24 13:08:09,100 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b4ea3b77af3c73ebe93d293f7384363, UNASSIGN 2023-07-24 13:08:09,100 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3b01550eba8bd5058ef5e4caa2cab9eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:09,100 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=5b4ea3b77af3c73ebe93d293f7384363, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:09,101 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204089100"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204089100"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204089100"}]},"ts":"1690204089100"} 2023-07-24 13:08:09,101 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204089100"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204089100"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204089100"}]},"ts":"1690204089100"} 2023-07-24 13:08:09,102 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 5b4ea3b77af3c73ebe93d293f7384363, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:08:09,103 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 3b01550eba8bd5058ef5e4caa2cab9eb, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:08:09,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 13:08:09,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:08:09,255 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5b4ea3b77af3c73ebe93d293f7384363, disabling compactions & flushes 2023-07-24 13:08:09,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:08:09,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:08:09,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. after waiting 0 ms 2023-07-24 13:08:09,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:08:09,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:08:09,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3b01550eba8bd5058ef5e4caa2cab9eb, disabling compactions & flushes 2023-07-24 13:08:09,256 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:08:09,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:08:09,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. after waiting 0 ms 2023-07-24 13:08:09,256 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:08:09,316 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:08:09,317 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:09,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363. 2023-07-24 13:08:09,318 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5b4ea3b77af3c73ebe93d293f7384363: 2023-07-24 13:08:09,320 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:08:09,321 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=5b4ea3b77af3c73ebe93d293f7384363, regionState=CLOSED 2023-07-24 13:08:09,321 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204089321"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204089321"}]},"ts":"1690204089321"} 2023-07-24 13:08:09,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:08:09,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-24 13:08:09,328 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 5b4ea3b77af3c73ebe93d293f7384363, server=jenkins-hbase4.apache.org,36751,1690203972794 in 220 msec 2023-07-24 13:08:09,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:09,330 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb. 2023-07-24 13:08:09,330 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3b01550eba8bd5058ef5e4caa2cab9eb: 2023-07-24 13:08:09,331 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=5b4ea3b77af3c73ebe93d293f7384363, UNASSIGN in 233 msec 2023-07-24 13:08:09,332 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:08:09,332 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=3b01550eba8bd5058ef5e4caa2cab9eb, regionState=CLOSED 2023-07-24 13:08:09,333 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690204089332"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204089332"}]},"ts":"1690204089332"} 2023-07-24 13:08:09,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-24 13:08:09,340 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 3b01550eba8bd5058ef5e4caa2cab9eb, server=jenkins-hbase4.apache.org,43049,1690203972978 in 231 msec 2023-07-24 13:08:09,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=100, resume processing ppid=99 2023-07-24 13:08:09,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=3b01550eba8bd5058ef5e4caa2cab9eb, UNASSIGN in 245 msec 2023-07-24 13:08:09,343 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204089343"}]},"ts":"1690204089343"} 2023-07-24 13:08:09,344 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 13:08:09,346 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 13:08:09,348 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 271 msec 2023-07-24 13:08:09,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 13:08:09,385 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 13:08:09,386 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,395 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,395 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,398 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,399 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,402 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,402 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,402 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,402 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,403 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 13:08:09,403 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 13:08:09,404 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:08:09,404 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:08:09,404 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 13:08:09,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 13:08:09,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:09,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:09,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:09,405 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,406 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:09,407 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/recovered.edits] 2023-07-24 13:08:09,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 13:08:09,408 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/recovered.edits] 2023-07-24 13:08:09,415 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/cf/599f8efd15de46aeb443b250190a1438 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/cf/599f8efd15de46aeb443b250190a1438 2023-07-24 13:08:09,419 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363/recovered.edits/9.seqid 2023-07-24 13:08:09,419 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/cf/be376fa87b6c4fb09f02e931d8f19d28 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/cf/be376fa87b6c4fb09f02e931d8f19d28 2023-07-24 13:08:09,420 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/5b4ea3b77af3c73ebe93d293f7384363 2023-07-24 13:08:09,427 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb/recovered.edits/9.seqid 2023-07-24 13:08:09,428 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testEmptyExportFileSystemState/3b01550eba8bd5058ef5e4caa2cab9eb 2023-07-24 13:08:09,428 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 13:08:09,431 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,434 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 13:08:09,436 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 13:08:09,437 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,437 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 13:08:09,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204089437"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:09,437 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204089437"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:09,440 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:08:09,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 3b01550eba8bd5058ef5e4caa2cab9eb, NAME => 'testtb-testEmptyExportFileSystemState,,1690204074952.3b01550eba8bd5058ef5e4caa2cab9eb.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 5b4ea3b77af3c73ebe93d293f7384363, NAME => 'testtb-testEmptyExportFileSystemState,1,1690204074952.5b4ea3b77af3c73ebe93d293f7384363.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:08:09,440 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 13:08:09,440 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204089440"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:09,450 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 13:08:09,452 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 13:08:09,453 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 66 msec 2023-07-24 13:08:09,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 13:08:09,509 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 13:08:09,517 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 13:08:09,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:09,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 13:08:09,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 13:08:09,553 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testEmptyExportFileSystemState Thread=764 (was 761) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:44420 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: LogDeleter #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:55578 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:36849 from appattempt_1690203982092_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:37379 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4482 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-361892281_1 at /127.0.0.1:46810 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:46830 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-361892281_1 at /127.0.0.1:55548 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=926 (was 905) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=533 (was 503) - SystemLoadAverage LEAK? -, ProcessCount=181 (was 184), AvailableMemoryMB=4992 (was 5172) 2023-07-24 13:08:09,553 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-24 13:08:09,580 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(147): before: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=764, OpenFileDescriptor=926, MaxFileDescriptor=60000, SystemLoadAverage=533, ProcessCount=181, AvailableMemoryMB=4988 2023-07-24 13:08:09,581 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=764 is superior to 500 2023-07-24 13:08:09,582 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 13:08:09,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:09,587 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 13:08:09,587 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 13:08:09,588 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 13:08:09,589 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 13:08:09,592 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:09,592 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:09,592 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f empty. 2023-07-24 13:08:09,592 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad empty. 2023-07-24 13:08:09,593 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:09,593 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:09,593 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 13:08:09,647 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 13:08:09,648 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6281cf4861e30e52a1bc34e60a7748ad, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:08:09,649 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => b860dc683404824a059b8f7eb13a654f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp 2023-07-24 13:08:09,689 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 13:08:09,691 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:08:09,691 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing 6281cf4861e30e52a1bc34e60a7748ad, disabling compactions & flushes 2023-07-24 13:08:09,691 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:09,691 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:09,691 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. after waiting 0 ms 2023-07-24 13:08:09,691 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:09,691 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:09,691 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for 6281cf4861e30e52a1bc34e60a7748ad: 2023-07-24 13:08:09,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:08:09,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing b860dc683404824a059b8f7eb13a654f, disabling compactions & flushes 2023-07-24 13:08:09,707 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:09,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:09,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. after waiting 0 ms 2023-07-24 13:08:09,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:09,707 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:09,707 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for b860dc683404824a059b8f7eb13a654f: 2023-07-24 13:08:09,711 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 13:08:09,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204089712"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204089712"}]},"ts":"1690204089712"} 2023-07-24 13:08:09,712 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204089712"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204089712"}]},"ts":"1690204089712"} 2023-07-24 13:08:09,723 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 13:08:09,724 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 13:08:09,725 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204089724"}]},"ts":"1690204089724"} 2023-07-24 13:08:09,726 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 13:08:09,731 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 13:08:09,732 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 13:08:09,732 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 13:08:09,732 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 13:08:09,732 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 13:08:09,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6281cf4861e30e52a1bc34e60a7748ad, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b860dc683404824a059b8f7eb13a654f, ASSIGN}] 2023-07-24 13:08:09,735 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b860dc683404824a059b8f7eb13a654f, ASSIGN 2023-07-24 13:08:09,735 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6281cf4861e30e52a1bc34e60a7748ad, ASSIGN 2023-07-24 13:08:09,736 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b860dc683404824a059b8f7eb13a654f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43049,1690203972978; forceNewPlan=false, retain=false 2023-07-24 13:08:09,736 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6281cf4861e30e52a1bc34e60a7748ad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36751,1690203972794; forceNewPlan=false, retain=false 2023-07-24 13:08:09,886 INFO [jenkins-hbase4:42065] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 13:08:09,890 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b860dc683404824a059b8f7eb13a654f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:09,890 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204089890"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204089890"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204089890"}]},"ts":"1690204089890"} 2023-07-24 13:08:09,891 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6281cf4861e30e52a1bc34e60a7748ad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:09,891 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204089890"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204089890"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204089890"}]},"ts":"1690204089890"} 2023-07-24 13:08:09,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 13:08:09,895 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure b860dc683404824a059b8f7eb13a654f, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:08:09,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure 6281cf4861e30e52a1bc34e60a7748ad, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:08:10,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:10,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6281cf4861e30e52a1bc34e60a7748ad, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 13:08:10,059 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. service=AccessControlService 2023-07-24 13:08:10,059 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:08:10,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:10,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:08:10,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:10,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:10,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:10,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b860dc683404824a059b8f7eb13a654f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 13:08:10,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. service=AccessControlService 2023-07-24 13:08:10,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 13:08:10,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:10,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 13:08:10,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:10,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:10,067 INFO [StoreOpener-6281cf4861e30e52a1bc34e60a7748ad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:10,072 INFO [StoreOpener-b860dc683404824a059b8f7eb13a654f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:10,077 DEBUG [StoreOpener-6281cf4861e30e52a1bc34e60a7748ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/cf 2023-07-24 13:08:10,078 DEBUG [StoreOpener-6281cf4861e30e52a1bc34e60a7748ad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/cf 2023-07-24 13:08:10,078 INFO [StoreOpener-6281cf4861e30e52a1bc34e60a7748ad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6281cf4861e30e52a1bc34e60a7748ad columnFamilyName cf 2023-07-24 13:08:10,079 INFO [StoreOpener-6281cf4861e30e52a1bc34e60a7748ad-1] regionserver.HStore(310): Store=6281cf4861e30e52a1bc34e60a7748ad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:08:10,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:10,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:10,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:10,111 DEBUG [StoreOpener-b860dc683404824a059b8f7eb13a654f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/cf 2023-07-24 13:08:10,111 DEBUG [StoreOpener-b860dc683404824a059b8f7eb13a654f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/cf 2023-07-24 13:08:10,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:08:10,111 INFO [StoreOpener-b860dc683404824a059b8f7eb13a654f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b860dc683404824a059b8f7eb13a654f columnFamilyName cf 2023-07-24 13:08:10,112 INFO [StoreOpener-b860dc683404824a059b8f7eb13a654f-1] regionserver.HStore(310): Store=b860dc683404824a059b8f7eb13a654f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 13:08:10,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6281cf4861e30e52a1bc34e60a7748ad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62096468, jitterRate=-0.07469052076339722}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:08:10,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6281cf4861e30e52a1bc34e60a7748ad: 2023-07-24 13:08:10,113 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:10,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad., pid=109, masterSystemTime=1690204090055 2023-07-24 13:08:10,114 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:10,116 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:10,116 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:10,116 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=6281cf4861e30e52a1bc34e60a7748ad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:10,117 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204090116"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204090116"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204090116"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204090116"}]},"ts":"1690204090116"} 2023-07-24 13:08:10,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:10,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 13:08:10,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b860dc683404824a059b8f7eb13a654f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66699089, jitterRate=-0.006106123328208923}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 13:08:10,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b860dc683404824a059b8f7eb13a654f: 2023-07-24 13:08:10,124 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f., pid=108, masterSystemTime=1690204090053 2023-07-24 13:08:10,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:10,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:10,128 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=b860dc683404824a059b8f7eb13a654f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,129 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204090128"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690204090128"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690204090128"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690204090128"}]},"ts":"1690204090128"} 2023-07-24 13:08:10,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-24 13:08:10,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure 6281cf4861e30e52a1bc34e60a7748ad, server=jenkins-hbase4.apache.org,36751,1690203972794 in 222 msec 2023-07-24 13:08:10,131 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6281cf4861e30e52a1bc34e60a7748ad, ASSIGN in 397 msec 2023-07-24 13:08:10,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-24 13:08:10,133 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure b860dc683404824a059b8f7eb13a654f, server=jenkins-hbase4.apache.org,43049,1690203972978 in 237 msec 2023-07-24 13:08:10,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=107, resume processing ppid=105 2023-07-24 13:08:10,136 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b860dc683404824a059b8f7eb13a654f, ASSIGN in 401 msec 2023-07-24 13:08:10,137 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 13:08:10,137 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204090137"}]},"ts":"1690204090137"} 2023-07-24 13:08:10,139 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 13:08:10,141 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 13:08:10,141 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 13:08:10,143 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 13:08:10,146 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:10,146 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:10,146 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:10,146 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:10,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 13:08:10,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 13:08:10,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 13:08:10,148 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 13:08:10,153 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 567 msec 2023-07-24 13:08:10,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 13:08:10,194 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 13:08:10,194 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testtb-testExportFileSystemStateWithSkipTmp get assigned. Timeout = 60000ms 2023-07-24 13:08:10,195 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:08:10,202 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3484): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned to meta. Checking AM states. 2023-07-24 13:08:10,203 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:08:10,203 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(3504): All regions for table testtb-testExportFileSystemStateWithSkipTmp assigned. 2023-07-24 13:08:10,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:10,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204090216 (current time:1690204090216). 2023-07-24 13:08:10,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:08:10,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x37e5b6a5 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:08:10,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@169c75a4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:08:10,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:10,244 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40422, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:10,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x37e5b6a5 to 127.0.0.1:59137 2023-07-24 13:08:10,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:10,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x184d4807 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:08:10,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2078535, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:08:10,297 DEBUG [hconnection-0x7743e184-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:10,311 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:10,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:10,328 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51168, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:10,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x184d4807 to 127.0.0.1:59137 2023-07-24 13:08:10,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:10,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 13:08:10,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:08:10,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:10,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:10,339 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:10,340 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690204690340 2023-07-24 13:08:10,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:10,341 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,343 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:08:10,343 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:08:10,344 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:10,346 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:10,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 10 msec 2023-07-24 13:08:10,348 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:10,349 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690204690349 2023-07-24 13:08:10,406 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,407 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 13:08:10,407 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:10,409 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 13:08:10,409 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 13:08:10,410 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,410 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,411 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:10,411 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:10,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:10,411 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:10,411 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:10,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:10,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:10,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:10,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:10,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:10,412 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:10,412 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,412 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,412 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:08:10,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 13:08:10,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 13:08:10,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:10,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:10,413 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 13:08:10,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,414 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:10,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,417 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:10,417 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:10,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,417 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:10,419 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:10,419 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,419 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:10,420 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:10,420 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:10,421 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:10,423 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:10,432 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,432 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,432 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,433 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:10,433 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,433 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:10,433 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:10,433 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,433 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:10,433 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,433 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:10,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:10,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:10,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:10,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:10,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:10,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 13:08:10,436 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7778699a[Count = 1] remaining members to acquire global barrier 2023-07-24 13:08:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:10,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:10,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:10,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:10,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:10,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 13:08:10,441 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7778699a[Count = 0] remaining members to acquire global barrier 2023-07-24 13:08:10,442 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 13:08:10,442 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,443 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,443 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,443 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,443 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,443 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:10,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,443 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:10,444 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:10,444 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:08:10,444 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:10,444 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,445 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:10,445 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:10,445 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:10,445 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:10,445 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. started... 2023-07-24 13:08:10,446 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:10,446 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:10,447 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b860dc683404824a059b8f7eb13a654f: 2023-07-24 13:08:10,448 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,448 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:10,448 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:10,448 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:08:10,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:10,448 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:08:10,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:10,448 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:10,453 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:10,454 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:10,454 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. started... 2023-07-24 13:08:10,456 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6281cf4861e30e52a1bc34e60a7748ad: 2023-07-24 13:08:10,456 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,456 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:10,456 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 13:08:10,573 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. completed. 2023-07-24 13:08:10,573 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:10,573 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:10,573 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:10,573 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,573 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:10,573 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:08:10,575 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:10,575 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:10,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:10,575 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:10,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:10,577 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:10,578 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,579 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:10,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:10,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:10,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:10,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:10,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:10,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:08:10,591 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 13:08:10,648 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:10,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:10,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:10,650 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:08:10,951 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:10,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:10,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:10,952 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 13:08:10,984 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. completed. 2023-07-24 13:08:10,984 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:10,984 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:10,984 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:10,984 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:10,984 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:10,984 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:08:11,001 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:11,001 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:11,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:11,002 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:11,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:11,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:11,011 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:11,012 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:11,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:11,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36751,1690203972794': 2023-07-24 13:08:11,015 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 13:08:11,015 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 13:08:11,015 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:08:11,015 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:08:11,015 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,015 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:08:11,017 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,017 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,017 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:11,017 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:11,017 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,017 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,017 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,017 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:11,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:11,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:11,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:11,018 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:11,018 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:11,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,019 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:11,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,020 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:11,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:11,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:11,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:11,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:11,022 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:11,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:11,022 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:11,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,023 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:11,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:11,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:11,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:11,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:11,029 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,029 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:11,029 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,030 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:11,030 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:11,029 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:11,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:11,030 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,037 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,029 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:11,037 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:11,037 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:11,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:11,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:11,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:11,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:11,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:11,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:11,118 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,214 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 13:08:11,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,215 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,215 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690204090341Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690204091029 (+688 ms)Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690204091029Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690204091065 (+36 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690204091112 (+47 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690204091214 (+102 ms) 2023-07-24 13:08:11,219 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:11,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 876 msec 2023-07-24 13:08:11,453 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:11,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:11,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:08:11,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36751] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:08:11,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43049] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 13:08:11,501 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,501 DEBUG [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:11,501 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 13:08:11,521 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:11,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690204091521 (current time:1690204091521). 2023-07-24 13:08:11,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 13:08:11,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x07353576 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:08:11,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6f12bbd5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:08:11,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:11,539 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39284, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:11,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07353576 to 127.0.0.1:59137 2023-07-24 13:08:11,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:11,541 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(139): Connect 0x6644e360 to 127.0.0.1:59137 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 13:08:11,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4874e45b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 13:08:11,580 DEBUG [hconnection-0x32423293-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:11,584 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39286, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:11,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 13:08:11,592 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51180, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 13:08:11,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6644e360 to 127.0.0.1:59137 2023-07-24 13:08:11,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:11,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 13:08:11,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 13:08:11,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:11,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:11,598 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:11,599 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690204691599 2023-07-24 13:08:11,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 13:08:11,599 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:11,600 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 13:08:11,601 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 13:08:11,602 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:11,602 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 13:08:11,604 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-24 13:08:11,605 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:11,606 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690204691606 2023-07-24 13:08:11,701 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:11,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:11,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:11,702 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 13:08:11,902 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:11,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:11,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:11,904 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 13:08:12,031 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,031 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 13:08:12,031 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:12,031 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 13:08:12,031 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 13:08:12,032 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,032 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,033 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:12,033 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:12,033 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:12,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:12,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:12,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:12,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:12,033 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,034 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,034 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,035 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,035 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,036 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:12,036 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,035 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 13:08:12,036 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:12,036 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:12,044 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:12,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:12,045 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:12,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,046 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:12,046 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:12,046 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36483,1690203972884' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:12,046 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 13:08:12,046 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 13:08:12,048 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 13:08:12,048 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 13:08:12,048 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 13:08:12,049 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,049 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:12,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:12,050 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,051 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,051 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,051 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,051 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:12,052 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,052 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:12,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:12,051 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,052 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 13:08:12,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:12,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:12,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,43049,1690203972978' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 13:08:12,054 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@660f5164[Count = 1] remaining members to acquire global barrier 2023-07-24 13:08:12,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:12,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:12,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:12,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:12,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:12,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,36751,1690203972794' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 13:08:12,057 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@660f5164[Count = 0] remaining members to acquire global barrier 2023-07-24 13:08:12,057 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 13:08:12,057 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,063 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,064 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,063 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,064 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:12,064 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:12,064 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,064 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 13:08:12,064 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:12,064 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36483,1690203972884' in zk 2023-07-24 13:08:12,064 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:12,064 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:12,065 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:12,065 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. started... 2023-07-24 13:08:12,065 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,065 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 13:08:12,065 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6281cf4861e30e52a1bc34e60a7748ad 1/1 column families, dataSize=333 B heapSize=976 B 2023-07-24 13:08:12,066 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:12,066 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:12,066 DEBUG [member: 'jenkins-hbase4.apache.org,36483,1690203972884' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:12,067 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 13:08:12,067 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 13:08:12,081 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:12,081 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. started... 2023-07-24 13:08:12,081 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2745): Flushing b860dc683404824a059b8f7eb13a654f 1/1 column families, dataSize=2.93 KB heapSize=6.58 KB 2023-07-24 13:08:12,103 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=333 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/.tmp/cf/a9bbf7939f604ad2a410e58dd53ae19f 2023-07-24 13:08:12,117 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/.tmp/cf/a9bbf7939f604ad2a410e58dd53ae19f as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/cf/a9bbf7939f604ad2a410e58dd53ae19f 2023-07-24 13:08:12,123 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/cf/a9bbf7939f604ad2a410e58dd53ae19f, entries=5, sequenceid=6, filesize=5.2 K 2023-07-24 13:08:12,125 INFO [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~333 B/333, heapSize ~960 B/960, currentSize=0 B/0 for 6281cf4861e30e52a1bc34e60a7748ad in 60ms, sequenceid=6, compaction requested=false 2023-07-24 13:08:12,125 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 13:08:12,126 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6281cf4861e30e52a1bc34e60a7748ad: 2023-07-24 13:08:12,126 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,126 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:12,126 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/cf/a9bbf7939f604ad2a410e58dd53ae19f] hfiles 2023-07-24 13:08:12,126 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/cf/a9bbf7939f604ad2a410e58dd53ae19f for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,155 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.93 KB at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/.tmp/cf/30b4451271ee47aa9f63f538207b4f97 2023-07-24 13:08:12,184 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/.tmp/cf/30b4451271ee47aa9f63f538207b4f97 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/cf/30b4451271ee47aa9f63f538207b4f97 2023-07-24 13:08:12,186 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. completed. 2023-07-24 13:08:12,186 DEBUG [rs(jenkins-hbase4.apache.org,36751,1690203972794)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:12,186 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,36751,1690203972794' in zk 2023-07-24 13:08:12,190 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,190 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:12,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,190 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:12,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:12,190 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:12,190 DEBUG [member: 'jenkins-hbase4.apache.org,36751,1690203972794' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:12,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:12,194 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/cf/30b4451271ee47aa9f63f538207b4f97, entries=45, sequenceid=6, filesize=7.9 K 2023-07-24 13:08:12,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:12,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,195 INFO [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~2.93 KB/3003, heapSize ~6.56 KB/6720, currentSize=0 B/0 for b860dc683404824a059b8f7eb13a654f in 114ms, sequenceid=6, compaction requested=false 2023-07-24 13:08:12,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,196 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for b860dc683404824a059b8f7eb13a654f: 2023-07-24 13:08:12,196 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,196 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 13:08:12,197 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/cf/30b4451271ee47aa9f63f538207b4f97] hfiles 2023-07-24 13:08:12,197 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/cf/30b4451271ee47aa9f63f538207b4f97 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:12,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,204 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:12,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:12,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 13:08:12,205 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 13:08:12,208 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,36751,1690203972794': 2023-07-24 13:08:12,208 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,36751,1690203972794' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 13:08:12,218 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. completed. 2023-07-24 13:08:12,218 DEBUG [rs(jenkins-hbase4.apache.org,43049,1690203972978)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:12,218 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 13:08:12,218 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 13:08:12,218 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,218 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 13:08:12,218 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,43049,1690203972978' in zk 2023-07-24 13:08:12,220 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 13:08:12,220 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,220 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:12,221 DEBUG [member: 'jenkins-hbase4.apache.org,43049,1690203972978' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 13:08:12,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:12,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:12,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:12,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:12,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:12,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,43049,1690203972978': 2023-07-24 13:08:12,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,43049,1690203972978' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 13:08:12,227 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 13:08:12,227 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 13:08:12,227 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 13:08:12,227 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,227 INFO [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 13:08:12,229 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:12,229 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 13:08:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 13:08:12,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,229 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:12,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 13:08:12,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:12,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:12,230 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 13:08:12,231 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,231 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 13:08:12,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,233 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,233 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,234 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,236 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,236 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,236 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,236 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:12,236 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:12,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:12,236 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:12,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:12,236 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:12,236 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 13:08:12,236 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:12,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 13:08:12,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 13:08:12,236 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:12,237 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 13:08:12,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:12,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:12,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:12,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:12,237 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,237 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,237 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:12,237 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,237 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:12,237 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:12,237 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,237 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,237 DEBUG [(jenkins-hbase4.apache.org,42065,1690203971321)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 13:08:12,237 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,239 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,239 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 13:08:12,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 13:08:12,240 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,277 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,331 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 13:08:12,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,331 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,331 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690204091599Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690204092239 (+640 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690204092239Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690204092247 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690204092267 (+20 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690204092331 (+64 ms) 2023-07-24 13:08:12,335 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 13:08:12,336 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 735 msec 2023-07-24 13:08:12,705 DEBUG [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 13:08:12,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 13:08:12,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 13:08:12,708 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204092708 2023-07-24 13:08:12,708 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:35185, tgtDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204092708, rawTgtDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204092708, srcFsUri=hdfs://localhost:35185, srcDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:08:12,755 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83 2023-07-24 13:08:12,755 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-627617139_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204092708, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204092708/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,755 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:35185, inputRoot=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83, snapshotDir=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 13:08:12,769 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204092708/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:12,824 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:12,824 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:12,825 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:12,825 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:13,250 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0006_000001 (auth:SIMPLE) 2023-07-24 13:08:13,885 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-6088614869936253625.jar 2023-07-24 13:08:13,885 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:13,886 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:13,955 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/hadoop-8954535217117303921.jar 2023-07-24 13:08:13,956 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:13,956 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:13,957 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:13,958 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:13,958 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:13,959 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 13:08:13,959 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 13:08:13,960 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 13:08:13,960 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 13:08:13,961 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 13:08:13,961 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 13:08:13,962 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 13:08:13,962 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 13:08:13,963 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 13:08:13,963 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 13:08:13,964 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 13:08:13,965 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:13,966 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:13,966 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:08:13,967 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:13,967 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 13:08:13,968 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:08:13,968 DEBUG [Listener at jenkins-hbase4.apache.org/43547] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 13:08:14,979 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:08:15,100 WARN [Listener at jenkins-hbase4.apache.org/43547] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 13:08:15,102 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 13:08:15,104 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(671): export split=0 size=13.0 K 2023-07-24 13:08:15,245 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:08:15,245 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 13:08:15,260 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0007_000001 (auth:SIMPLE) 2023-07-24 13:08:21,151 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0007_000001 (auth:SIMPLE) 2023-07-24 13:08:23,479 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0007_000001 (auth:SIMPLE) 2023-07-24 13:08:27,889 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690203982092_0007_000001 (auth:SIMPLE) 2023-07-24 13:08:29,484 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 13:08:29,484 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 13:08:29,496 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,496 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 13:08:29,497 INFO [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 13:08:29,497 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,497 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 13:08:29,497 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 13:08:29,497 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1195241042_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204092708/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204092708/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,498 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204092708/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 13:08:29,498 DEBUG [Listener at jenkins-hbase4.apache.org/43547] snapshot.TestExportSnapshot(367): hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/export-test/export-1690204092708/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 13:08:29,509 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 13:08:29,515 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204109515"}]},"ts":"1690204109515"} 2023-07-24 13:08:29,516 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 13:08:29,518 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 13:08:29,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6281cf4861e30e52a1bc34e60a7748ad, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b860dc683404824a059b8f7eb13a654f, UNASSIGN}] 2023-07-24 13:08:29,520 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b860dc683404824a059b8f7eb13a654f, UNASSIGN 2023-07-24 13:08:29,522 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6281cf4861e30e52a1bc34e60a7748ad, UNASSIGN 2023-07-24 13:08:29,523 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b860dc683404824a059b8f7eb13a654f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:29,523 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6281cf4861e30e52a1bc34e60a7748ad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:29,523 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204109523"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204109523"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204109523"}]},"ts":"1690204109523"} 2023-07-24 13:08:29,524 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204109523"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690204109523"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690204109523"}]},"ts":"1690204109523"} 2023-07-24 13:08:29,526 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE; CloseRegionProcedure b860dc683404824a059b8f7eb13a654f, server=jenkins-hbase4.apache.org,43049,1690203972978}] 2023-07-24 13:08:29,526 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=115, state=RUNNABLE; CloseRegionProcedure 6281cf4861e30e52a1bc34e60a7748ad, server=jenkins-hbase4.apache.org,36751,1690203972794}] 2023-07-24 13:08:29,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 13:08:29,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:29,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:29,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b860dc683404824a059b8f7eb13a654f, disabling compactions & flushes 2023-07-24 13:08:29,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6281cf4861e30e52a1bc34e60a7748ad, disabling compactions & flushes 2023-07-24 13:08:29,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:29,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:29,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:29,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:29,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. after waiting 0 ms 2023-07-24 13:08:29,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:29,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. after waiting 0 ms 2023-07-24 13:08:29,679 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:29,696 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:08:29,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:29,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad. 2023-07-24 13:08:29,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6281cf4861e30e52a1bc34e60a7748ad: 2023-07-24 13:08:29,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:08:29,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:29,699 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f. 2023-07-24 13:08:29,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b860dc683404824a059b8f7eb13a654f: 2023-07-24 13:08:29,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:29,702 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=6281cf4861e30e52a1bc34e60a7748ad, regionState=CLOSED 2023-07-24 13:08:29,702 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204109702"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204109702"}]},"ts":"1690204109702"} 2023-07-24 13:08:29,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:29,704 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=b860dc683404824a059b8f7eb13a654f, regionState=CLOSED 2023-07-24 13:08:29,704 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690204109704"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690204109704"}]},"ts":"1690204109704"} 2023-07-24 13:08:29,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=115 2023-07-24 13:08:29,708 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=115, state=SUCCESS; CloseRegionProcedure 6281cf4861e30e52a1bc34e60a7748ad, server=jenkins-hbase4.apache.org,36751,1690203972794 in 179 msec 2023-07-24 13:08:29,709 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=6281cf4861e30e52a1bc34e60a7748ad, UNASSIGN in 189 msec 2023-07-24 13:08:29,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=116 2023-07-24 13:08:29,710 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=116, state=SUCCESS; CloseRegionProcedure b860dc683404824a059b8f7eb13a654f, server=jenkins-hbase4.apache.org,43049,1690203972978 in 182 msec 2023-07-24 13:08:29,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-24 13:08:29,712 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=b860dc683404824a059b8f7eb13a654f, UNASSIGN in 191 msec 2023-07-24 13:08:29,712 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690204109712"}]},"ts":"1690204109712"} 2023-07-24 13:08:29,714 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 13:08:29,716 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 13:08:29,718 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 207 msec 2023-07-24 13:08:29,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 13:08:29,817 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 13:08:29,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,823 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,825 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36483] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,826 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,830 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,830 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,830 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,830 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 13:08:29,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 13:08:29,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 13:08:29,834 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 13:08:29,835 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,835 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:29,835 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,835 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:29,837 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,837 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,837 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:29,837 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 13:08:29,838 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:29,838 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:29,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 13:08:29,841 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/recovered.edits] 2023-07-24 13:08:29,841 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/cf, FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/recovered.edits] 2023-07-24 13:08:29,849 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/cf/a9bbf7939f604ad2a410e58dd53ae19f to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/cf/a9bbf7939f604ad2a410e58dd53ae19f 2023-07-24 13:08:29,855 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/cf/30b4451271ee47aa9f63f538207b4f97 to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/cf/30b4451271ee47aa9f63f538207b4f97 2023-07-24 13:08:29,865 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad/recovered.edits/9.seqid 2023-07-24 13:08:29,868 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/recovered.edits/9.seqid to hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f/recovered.edits/9.seqid 2023-07-24 13:08:29,869 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/b860dc683404824a059b8f7eb13a654f 2023-07-24 13:08:29,869 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/6281cf4861e30e52a1bc34e60a7748ad 2023-07-24 13:08:29,869 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 13:08:29,872 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,889 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 13:08:29,898 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 13:08:29,900 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,900 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 13:08:29,900 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204109900"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:29,900 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690204109900"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:29,902 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 13:08:29,902 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6281cf4861e30e52a1bc34e60a7748ad, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690204089582.6281cf4861e30e52a1bc34e60a7748ad.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b860dc683404824a059b8f7eb13a654f, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690204089582.b860dc683404824a059b8f7eb13a654f.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 13:08:29,902 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 13:08:29,902 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690204109902"}]},"ts":"9223372036854775807"} 2023-07-24 13:08:29,917 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 13:08:29,921 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,923 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 102 msec 2023-07-24 13:08:29,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 13:08:29,940 INFO [Listener at jenkins-hbase4.apache.org/43547] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 13:08:29,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 13:08:29,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:29,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 13:08:29,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42065] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 13:08:30,010 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(175): after: snapshot.TestSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=766 (was 764) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-43 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:35116 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1484284473) connection to jenkins-hbase4.apache.org/172.31.14.131:46755 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212643378_1 at /127.0.0.1:36360 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:36370 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-1195241042_17 at /127.0.0.1:54046 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-5091 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-44 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x7dc11d1a-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1212643378_1 at /127.0.0.1:54012 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=899 (was 926), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=702 (was 533) - SystemLoadAverage LEAK? -, ProcessCount=184 (was 181) - ProcessCount LEAK? -, AvailableMemoryMB=4118 (was 4988) 2023-07-24 13:08:30,010 WARN [Listener at jenkins-hbase4.apache.org/43547] hbase.ResourceChecker(130): Thread=766 is superior to 500 2023-07-24 13:08:30,010 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 13:08:30,028 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 13:08:30,158 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690203982092_0007_01_000001 is : 143 2023-07-24 13:08:35,309 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 13:08:44,166 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 13:08:58,287 ERROR [Thread[Thread-411,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 13:08:58,288 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 13:08:58,408 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 13:08:58,443 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 13:08:58,445 ERROR [Thread[Thread-421,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 13:08:58,479 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 13:08:58,584 ERROR [Thread[Thread-385,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 13:08:58,584 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 13:08:58,584 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 13:08:58,584 INFO [Listener at jenkins-hbase4.apache.org/43547] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 13:08:58,585 DEBUG [Listener at jenkins-hbase4.apache.org/43547] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x776a4d8e to 127.0.0.1:59137 2023-07-24 13:08:58,585 DEBUG [Listener at jenkins-hbase4.apache.org/43547] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:58,585 DEBUG [Listener at jenkins-hbase4.apache.org/43547] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 13:08:58,585 DEBUG [Listener at jenkins-hbase4.apache.org/43547] util.JVMClusterUtil(257): Found active master hash=1975035530, stopped=false 2023-07-24 13:08:58,585 DEBUG [Listener at jenkins-hbase4.apache.org/43547] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:58,585 DEBUG [Listener at jenkins-hbase4.apache.org/43547] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 13:08:58,585 INFO [Listener at jenkins-hbase4.apache.org/43547] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,42065,1690203971321 2023-07-24 13:08:58,587 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 13:08:58,587 INFO [Listener at jenkins-hbase4.apache.org/43547] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 13:08:58,587 DEBUG [Listener at jenkins-hbase4.apache.org/43547] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51eef03f to 127.0.0.1:59137 2023-07-24 13:08:58,587 DEBUG [Listener at jenkins-hbase4.apache.org/43547] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:58,587 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 13:08:58,588 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:08:58,588 INFO [Listener at jenkins-hbase4.apache.org/43547] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36751,1690203972794' ***** 2023-07-24 13:08:58,587 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 13:08:58,587 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 13:08:58,588 DEBUG [Listener at jenkins-hbase4.apache.org/43547] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:58,587 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:08:58,588 INFO [Listener at jenkins-hbase4.apache.org/43547] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 13:08:58,588 INFO [Listener at jenkins-hbase4.apache.org/43547] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,36483,1690203972884' ***** 2023-07-24 13:08:58,588 INFO [RS:0;jenkins-hbase4:36751] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 13:08:58,588 DEBUG [Listener at jenkins-hbase4.apache.org/43547] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:58,588 INFO [Listener at jenkins-hbase4.apache.org/43547] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 13:08:58,589 INFO [Listener at jenkins-hbase4.apache.org/43547] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,43049,1690203972978' ***** 2023-07-24 13:08:58,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:08:58,589 DEBUG [Listener at jenkins-hbase4.apache.org/43547] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:58,589 INFO [RS:1;jenkins-hbase4:36483] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 13:08:58,589 INFO [Listener at jenkins-hbase4.apache.org/43547] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 13:08:58,589 INFO [RS:1;jenkins-hbase4:36483] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 13:08:58,589 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 13:08:58,589 INFO [RS:2;jenkins-hbase4:43049] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 13:08:58,589 INFO [RS:1;jenkins-hbase4:36483] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 13:08:58,589 INFO [RS:2;jenkins-hbase4:43049] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 13:08:58,589 INFO [RS:0;jenkins-hbase4:36751] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 13:08:58,589 INFO [RS:2;jenkins-hbase4:43049] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 13:08:58,589 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 13:08:58,589 INFO [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:58,589 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 13:08:58,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:08:58,590 DEBUG [RS:2;jenkins-hbase4:43049] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x23520e65 to 127.0.0.1:59137 2023-07-24 13:08:58,590 DEBUG [RS:2;jenkins-hbase4:43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:58,589 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 13:08:58,589 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(3305): Received CLOSE for 3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:08:58,589 INFO [RS:0;jenkins-hbase4:36751] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 13:08:58,593 INFO [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(3305): Received CLOSE for 938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:08:58,594 INFO [RS:2;jenkins-hbase4:43049] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 13:08:58,594 INFO [RS:2;jenkins-hbase4:43049] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 13:08:58,594 INFO [RS:2;jenkins-hbase4:43049] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 13:08:58,594 INFO [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:58,594 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:58,595 DEBUG [RS:0;jenkins-hbase4:36751] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6f2a1dcd to 127.0.0.1:59137 2023-07-24 13:08:58,595 DEBUG [RS:0;jenkins-hbase4:36751] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:58,595 INFO [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 13:08:58,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3326ec7ed9f21fb6c68e628d8708a54f, disabling compactions & flushes 2023-07-24 13:08:58,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 938e272863b8cbff56246ac36d5f8fe8, disabling compactions & flushes 2023-07-24 13:08:58,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:08:58,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:08:58,596 INFO [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 13:08:58,595 DEBUG [RS:1;jenkins-hbase4:36483] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2411f5c7 to 127.0.0.1:59137 2023-07-24 13:08:58,596 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1478): Online Regions={938e272863b8cbff56246ac36d5f8fe8=hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8.} 2023-07-24 13:08:58,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. after waiting 0 ms 2023-07-24 13:08:58,596 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:08:58,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3326ec7ed9f21fb6c68e628d8708a54f 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 13:08:58,596 INFO [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 13:08:58,597 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-24 13:08:58,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:08:58,597 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 13:08:58,597 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 13:08:58,598 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 13:08:58,598 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 13:08:58,598 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 13:08:58,596 DEBUG [RS:1;jenkins-hbase4:36483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:58,598 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 13:08:58,597 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:08:58,598 DEBUG [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1504): Waiting on 938e272863b8cbff56246ac36d5f8fe8 2023-07-24 13:08:58,599 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 13:08:58,599 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1478): Online Regions={3326ec7ed9f21fb6c68e628d8708a54f=hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f.} 2023-07-24 13:08:58,599 DEBUG [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1504): Waiting on 3326ec7ed9f21fb6c68e628d8708a54f 2023-07-24 13:08:58,598 DEBUG [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 13:08:58,598 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. after waiting 0 ms 2023-07-24 13:08:58,600 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:08:58,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 938e272863b8cbff56246ac36d5f8fe8 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 13:08:58,638 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:08:58,655 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f/.tmp/l/85ceb110bb3d4307b361e155f5bce070 2023-07-24 13:08:58,661 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:08:58,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8/.tmp/info/6e8dd28b0f9c412fa5e1b8f829d03da3 2023-07-24 13:08:58,665 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:08:58,667 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/.tmp/info/51caa98beb014127b3c98af5126f6b11 2023-07-24 13:08:58,670 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85ceb110bb3d4307b361e155f5bce070 2023-07-24 13:08:58,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f/.tmp/l/85ceb110bb3d4307b361e155f5bce070 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f/l/85ceb110bb3d4307b361e155f5bce070 2023-07-24 13:08:58,673 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8/.tmp/info/6e8dd28b0f9c412fa5e1b8f829d03da3 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8/info/6e8dd28b0f9c412fa5e1b8f829d03da3 2023-07-24 13:08:58,673 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51caa98beb014127b3c98af5126f6b11 2023-07-24 13:08:58,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 85ceb110bb3d4307b361e155f5bce070 2023-07-24 13:08:58,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f/l/85ceb110bb3d4307b361e155f5bce070, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 13:08:58,678 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 3326ec7ed9f21fb6c68e628d8708a54f in 81ms, sequenceid=18, compaction requested=false 2023-07-24 13:08:58,679 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8/info/6e8dd28b0f9c412fa5e1b8f829d03da3, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 13:08:58,680 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for 938e272863b8cbff56246ac36d5f8fe8 in 80ms, sequenceid=6, compaction requested=false 2023-07-24 13:08:58,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/namespace/938e272863b8cbff56246ac36d5f8fe8/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 13:08:58,698 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/acl/3326ec7ed9f21fb6c68e628d8708a54f/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 13:08:58,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:58,699 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:58,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:08:58,701 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:08:58,701 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 938e272863b8cbff56246ac36d5f8fe8: 2023-07-24 13:08:58,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3326ec7ed9f21fb6c68e628d8708a54f: 2023-07-24 13:08:58,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690203976703.3326ec7ed9f21fb6c68e628d8708a54f. 2023-07-24 13:08:58,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690203975850.938e272863b8cbff56246ac36d5f8fe8. 2023-07-24 13:08:58,704 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/.tmp/rep_barrier/0fb99095bb354ac1a351f70c2c19157d 2023-07-24 13:08:58,708 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fb99095bb354ac1a351f70c2c19157d 2023-07-24 13:08:58,721 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/.tmp/table/03a411e6965843f588da4f99554dab0c 2023-07-24 13:08:58,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03a411e6965843f588da4f99554dab0c 2023-07-24 13:08:58,727 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/.tmp/info/51caa98beb014127b3c98af5126f6b11 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/info/51caa98beb014127b3c98af5126f6b11 2023-07-24 13:08:58,733 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 51caa98beb014127b3c98af5126f6b11 2023-07-24 13:08:58,733 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/info/51caa98beb014127b3c98af5126f6b11, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 13:08:58,734 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/.tmp/rep_barrier/0fb99095bb354ac1a351f70c2c19157d as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/rep_barrier/0fb99095bb354ac1a351f70c2c19157d 2023-07-24 13:08:58,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fb99095bb354ac1a351f70c2c19157d 2023-07-24 13:08:58,738 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/rep_barrier/0fb99095bb354ac1a351f70c2c19157d, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 13:08:58,739 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/.tmp/table/03a411e6965843f588da4f99554dab0c as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/table/03a411e6965843f588da4f99554dab0c 2023-07-24 13:08:58,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03a411e6965843f588da4f99554dab0c 2023-07-24 13:08:58,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/table/03a411e6965843f588da4f99554dab0c, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 13:08:58,745 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 147ms, sequenceid=131, compaction requested=false 2023-07-24 13:08:58,756 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 13:08:58,757 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 13:08:58,757 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 13:08:58,758 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 13:08:58,758 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 13:08:58,758 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 13:08:58,799 INFO [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36751,1690203972794; all regions closed. 2023-07-24 13:08:58,799 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,36483,1690203972884; all regions closed. 2023-07-24 13:08:58,799 INFO [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,43049,1690203972978; all regions closed. 2023-07-24 13:08:58,813 DEBUG [RS:0;jenkins-hbase4:36751] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/oldWALs 2023-07-24 13:08:58,813 DEBUG [RS:2;jenkins-hbase4:43049] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/oldWALs 2023-07-24 13:08:58,813 INFO [RS:0;jenkins-hbase4:36751] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36751%2C1690203972794:(num 1690203975235) 2023-07-24 13:08:58,813 DEBUG [RS:1;jenkins-hbase4:36483] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/oldWALs 2023-07-24 13:08:58,813 INFO [RS:1;jenkins-hbase4:36483] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36483%2C1690203972884:(num 1690203975229) 2023-07-24 13:08:58,813 DEBUG [RS:1;jenkins-hbase4:36483] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:58,813 DEBUG [RS:0;jenkins-hbase4:36751] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:58,813 INFO [RS:1;jenkins-hbase4:36483] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:08:58,813 INFO [RS:0;jenkins-hbase4:36751] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:08:58,813 INFO [RS:2;jenkins-hbase4:43049] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43049%2C1690203972978.meta:.meta(num 1690203975514) 2023-07-24 13:08:58,813 INFO [RS:1;jenkins-hbase4:36483] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 13:08:58,813 INFO [RS:0;jenkins-hbase4:36751] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 13:08:58,814 INFO [RS:1;jenkins-hbase4:36483] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 13:08:58,814 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 13:08:58,814 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 13:08:58,814 INFO [RS:1;jenkins-hbase4:36483] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 13:08:58,814 INFO [RS:0;jenkins-hbase4:36751] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 13:08:58,815 INFO [RS:0;jenkins-hbase4:36751] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 13:08:58,815 INFO [RS:0;jenkins-hbase4:36751] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 13:08:58,815 INFO [RS:1;jenkins-hbase4:36483] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 13:08:58,816 INFO [RS:0;jenkins-hbase4:36751] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36751 2023-07-24 13:08:58,816 INFO [RS:1;jenkins-hbase4:36483] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36483 2023-07-24 13:08:58,822 DEBUG [RS:2;jenkins-hbase4:43049] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/oldWALs 2023-07-24 13:08:58,822 INFO [RS:2;jenkins-hbase4:43049] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43049%2C1690203972978:(num 1690203975224) 2023-07-24 13:08:58,822 DEBUG [RS:2;jenkins-hbase4:43049] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:58,822 INFO [RS:2;jenkins-hbase4:43049] regionserver.LeaseManager(133): Closed leases 2023-07-24 13:08:58,822 INFO [RS:2;jenkins-hbase4:43049] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 13:08:58,822 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 13:08:58,823 INFO [RS:2;jenkins-hbase4:43049] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43049 2023-07-24 13:08:58,825 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:58,825 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:58,825 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:08:58,825 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36751,1690203972794 2023-07-24 13:08:58,825 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:08:58,825 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:08:58,825 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 13:08:58,826 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:58,826 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:58,826 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36483,1690203972884 2023-07-24 13:08:58,826 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:58,826 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:58,826 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43049,1690203972978 2023-07-24 13:08:58,831 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36483,1690203972884] 2023-07-24 13:08:58,831 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36483,1690203972884; numProcessing=1 2023-07-24 13:08:58,832 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36483,1690203972884 already deleted, retry=false 2023-07-24 13:08:58,832 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36483,1690203972884 expired; onlineServers=2 2023-07-24 13:08:58,832 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36751,1690203972794] 2023-07-24 13:08:58,833 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36751,1690203972794; numProcessing=2 2023-07-24 13:08:58,833 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36751,1690203972794 already deleted, retry=false 2023-07-24 13:08:58,833 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,36751,1690203972794 expired; onlineServers=1 2023-07-24 13:08:58,833 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43049,1690203972978] 2023-07-24 13:08:58,834 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43049,1690203972978; numProcessing=3 2023-07-24 13:08:58,836 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43049,1690203972978 already deleted, retry=false 2023-07-24 13:08:58,836 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,43049,1690203972978 expired; onlineServers=0 2023-07-24 13:08:58,836 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42065,1690203971321' ***** 2023-07-24 13:08:58,836 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 13:08:58,836 DEBUG [M:0;jenkins-hbase4:42065] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3485acb1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 13:08:58,837 INFO [M:0;jenkins-hbase4:42065] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42065,1690203971321 2023-07-24 13:08:58,837 INFO [M:0;jenkins-hbase4:42065] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42065,1690203971321; all regions closed. 2023-07-24 13:08:58,837 DEBUG [M:0;jenkins-hbase4:42065] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 13:08:58,837 DEBUG [M:0;jenkins-hbase4:42065] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 13:08:58,837 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 13:08:58,837 DEBUG [M:0;jenkins-hbase4:42065] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 13:08:58,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690203974703] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690203974703,5,FailOnTimeoutGroup] 2023-07-24 13:08:58,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690203974702] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690203974702,5,FailOnTimeoutGroup] 2023-07-24 13:08:58,837 INFO [M:0;jenkins-hbase4:42065] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 13:08:58,837 INFO [M:0;jenkins-hbase4:42065] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 13:08:58,837 INFO [M:0;jenkins-hbase4:42065] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 13:08:58,837 DEBUG [M:0;jenkins-hbase4:42065] master.HMaster(1512): Stopping service threads 2023-07-24 13:08:58,837 INFO [M:0;jenkins-hbase4:42065] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 13:08:58,838 ERROR [M:0;jenkins-hbase4:42065] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 13:08:58,838 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 13:08:58,838 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 13:08:58,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 13:08:58,838 INFO [M:0;jenkins-hbase4:42065] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 13:08:58,838 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 13:08:58,839 DEBUG [M:0;jenkins-hbase4:42065] zookeeper.ZKUtil(398): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-24 13:08:58,839 WARN [M:0;jenkins-hbase4:42065] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-24 13:08:58,839 INFO [M:0;jenkins-hbase4:42065] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 13:08:58,839 INFO [M:0;jenkins-hbase4:42065] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 13:08:58,840 DEBUG [M:0;jenkins-hbase4:42065] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 13:08:58,840 INFO [M:0;jenkins-hbase4:42065] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:08:58,840 DEBUG [M:0;jenkins-hbase4:42065] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:08:58,840 DEBUG [M:0;jenkins-hbase4:42065] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 13:08:58,840 DEBUG [M:0;jenkins-hbase4:42065] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:08:58,840 INFO [M:0;jenkins-hbase4:42065] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=373.17 KB heapSize=449.44 KB 2023-07-24 13:08:58,861 INFO [M:0;jenkins-hbase4:42065] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=373.17 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a94837b81c4c4deaa0b306d5a0994492 2023-07-24 13:08:58,865 INFO [M:0;jenkins-hbase4:42065] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a94837b81c4c4deaa0b306d5a0994492 2023-07-24 13:08:58,866 DEBUG [M:0;jenkins-hbase4:42065] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/a94837b81c4c4deaa0b306d5a0994492 as hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a94837b81c4c4deaa0b306d5a0994492 2023-07-24 13:08:58,870 INFO [M:0;jenkins-hbase4:42065] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a94837b81c4c4deaa0b306d5a0994492 2023-07-24 13:08:58,870 INFO [M:0;jenkins-hbase4:42065] regionserver.HStore(1080): Added hdfs://localhost:35185/user/jenkins/test-data/19a16c73-6f3d-1f44-8019-db81b0a59c83/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/a94837b81c4c4deaa0b306d5a0994492, entries=119, sequenceid=899, filesize=28.4 K 2023-07-24 13:08:58,871 INFO [M:0;jenkins-hbase4:42065] regionserver.HRegion(2948): Finished flush of dataSize ~373.17 KB/382124, heapSize ~449.42 KB/460208, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=899, compaction requested=false 2023-07-24 13:08:58,873 INFO [M:0;jenkins-hbase4:42065] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 13:08:58,873 DEBUG [M:0;jenkins-hbase4:42065] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 13:08:58,879 INFO [M:0;jenkins-hbase4:42065] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 13:08:58,880 INFO [M:0;jenkins-hbase4:42065] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42065 2023-07-24 13:08:58,880 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 13:08:58,882 DEBUG [M:0;jenkins-hbase4:42065] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,42065,1690203971321 already deleted, retry=false 2023-07-24 13:08:58,931 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:08:58,931 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36751-0x10197705e200001, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:08:58,931 INFO [RS:0;jenkins-hbase4:36751] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36751,1690203972794; zookeeper connection closed. 2023-07-24 13:08:58,931 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@540d9fb7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@540d9fb7 2023-07-24 13:08:59,031 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:08:59,031 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): master:42065-0x10197705e200000, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:08:59,031 INFO [M:0;jenkins-hbase4:42065] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42065,1690203971321; zookeeper connection closed. 2023-07-24 13:08:59,131 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:08:59,131 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:43049-0x10197705e200003, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:08:59,131 INFO [RS:2;jenkins-hbase4:43049] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,43049,1690203972978; zookeeper connection closed. 2023-07-24 13:08:59,132 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4e9b9c89] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4e9b9c89 2023-07-24 13:08:59,231 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:08:59,232 DEBUG [Listener at localhost/35307-EventThread] zookeeper.ZKWatcher(600): regionserver:36483-0x10197705e200002, quorum=127.0.0.1:59137, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 13:08:59,231 INFO [RS:1;jenkins-hbase4:36483] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,36483,1690203972884; zookeeper connection closed. 2023-07-24 13:08:59,232 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4f80b48] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4f80b48 2023-07-24 13:08:59,232 INFO [Listener at jenkins-hbase4.apache.org/43547] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 13:08:59,232 WARN [Listener at jenkins-hbase4.apache.org/43547] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 13:08:59,237 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 13:08:59,239 WARN [37128373@qtp-685103272-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44997] http.HttpServer2$SelectChannelConnectorWithSafeStartup(546): HttpServer Acceptor: isRunning is false. Rechecking. 2023-07-24 13:08:59,239 WARN [37128373@qtp-685103272-1 - Acceptor0 HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44997] http.HttpServer2$SelectChannelConnectorWithSafeStartup(555): HttpServer Acceptor: isRunning is false 2023-07-24 13:08:59,343 WARN [BP-1936302590-172.31.14.131-1690203966871 heartbeating to localhost/127.0.0.1:35185] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 13:08:59,343 WARN [BP-1936302590-172.31.14.131-1690203966871 heartbeating to localhost/127.0.0.1:35185] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1936302590-172.31.14.131-1690203966871 (Datanode Uuid cf85e342-d15c-4b59-964b-42d18f0b2eed) service to localhost/127.0.0.1:35185 2023-07-24 13:08:59,345 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data5/current/BP-1936302590-172.31.14.131-1690203966871] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:08:59,345 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data6/current/BP-1936302590-172.31.14.131-1690203966871] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:08:59,346 WARN [Listener at jenkins-hbase4.apache.org/43547] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 13:08:59,351 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 13:08:59,454 WARN [BP-1936302590-172.31.14.131-1690203966871 heartbeating to localhost/127.0.0.1:35185] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 13:08:59,454 WARN [BP-1936302590-172.31.14.131-1690203966871 heartbeating to localhost/127.0.0.1:35185] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1936302590-172.31.14.131-1690203966871 (Datanode Uuid 070d2424-ccd1-47e8-9c31-b4431c2b8a08) service to localhost/127.0.0.1:35185 2023-07-24 13:08:59,455 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data3/current/BP-1936302590-172.31.14.131-1690203966871] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:08:59,455 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data4/current/BP-1936302590-172.31.14.131-1690203966871] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:08:59,456 WARN [Listener at jenkins-hbase4.apache.org/43547] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 13:08:59,460 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 13:08:59,564 WARN [BP-1936302590-172.31.14.131-1690203966871 heartbeating to localhost/127.0.0.1:35185] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 13:08:59,565 WARN [BP-1936302590-172.31.14.131-1690203966871 heartbeating to localhost/127.0.0.1:35185] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1936302590-172.31.14.131-1690203966871 (Datanode Uuid f9977a1f-66fd-4c19-8c83-4c83f9cd3f8d) service to localhost/127.0.0.1:35185 2023-07-24 13:08:59,565 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data1/current/BP-1936302590-172.31.14.131-1690203966871] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:08:59,566 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/d4390608-eab3-cfb3-4829-591866522d83/cluster_d57d8116-f3c1-38aa-c39a-d9753ceff394/dfs/data/data2/current/BP-1936302590-172.31.14.131-1690203966871] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 13:08:59,589 INFO [Listener at jenkins-hbase4.apache.org/43547] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 13:08:59,714 INFO [Listener at jenkins-hbase4.apache.org/43547] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 13:08:59,810 INFO [Listener at jenkins-hbase4.apache.org/43547] hbase.HBaseTestingUtility(1293): Minicluster is down