2023-07-24 23:06:02,648 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestExportSnapshot timeout: 13 mins 2023-07-24 23:06:02,903 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a 2023-07-24 23:06:02,904 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobExportSnapshot timeout: 13 mins 2023-07-24 23:06:02,904 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.snapshot.TestMobSecureExportSnapshot timeout: 13 mins 2023-07-24 23:06:02,947 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-07-24 23:06:03,176 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=3, rsPorts=, rsClass=null, numDataNodes=3, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-07-24 23:06:03,176 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83, deleteOnExit=true 2023-07-24 23:06:03,176 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-07-24 23:06:03,177 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/test.cache.data in system properties and HBase conf 2023-07-24 23:06:03,177 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 23:06:03,178 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop.log.dir in system properties and HBase conf 2023-07-24 23:06:03,178 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 23:06:03,179 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 23:06:03,179 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 23:06:03,484 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-07-24 23:06:03,490 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 23:06:03,491 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 23:06:03,491 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 23:06:03,492 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 23:06:03,492 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 23:06:03,493 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 23:06:03,493 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 23:06:03,494 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 23:06:03,494 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 23:06:03,495 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/nfs.dump.dir in system properties and HBase conf 2023-07-24 23:06:03,495 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/java.io.tmpdir in system properties and HBase conf 2023-07-24 23:06:03,495 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 23:06:03,496 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 23:06:03,499 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-07-24 23:06:04,130 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 23:06:04,134 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 23:06:04,416 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-07-24 23:06:04,587 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-07-24 23:06:04,608 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:04,644 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:04,683 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/java.io.tmpdir/Jetty_localhost_37605_hdfs____kpcltt/webapp 2023-07-24 23:06:04,850 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37605 2023-07-24 23:06:04,880 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-07-24 23:06:04,881 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-07-24 23:06:05,395 WARN [Listener at localhost/33513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 23:06:05,505 WARN [Listener at localhost/33513] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 23:06:05,535 WARN [Listener at localhost/33513] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:05,543 INFO [Listener at localhost/33513] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:05,553 INFO [Listener at localhost/33513] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/java.io.tmpdir/Jetty_localhost_39745_datanode____vl5whl/webapp 2023-07-24 23:06:05,692 INFO [Listener at localhost/33513] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39745 2023-07-24 23:06:06,181 WARN [Listener at localhost/38893] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 23:06:06,228 WARN [Listener at localhost/38893] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 23:06:06,240 WARN [Listener at localhost/38893] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:06,245 INFO [Listener at localhost/38893] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:06,253 INFO [Listener at localhost/38893] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/java.io.tmpdir/Jetty_localhost_43665_datanode____.820qdf/webapp 2023-07-24 23:06:06,379 INFO [Listener at localhost/38893] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43665 2023-07-24 23:06:06,415 WARN [Listener at localhost/35513] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 23:06:06,459 WARN [Listener at localhost/35513] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-07-24 23:06:06,462 WARN [Listener at localhost/35513] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:06,465 INFO [Listener at localhost/35513] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:06,475 INFO [Listener at localhost/35513] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/java.io.tmpdir/Jetty_localhost_44317_datanode____bu2ow0/webapp 2023-07-24 23:06:06,619 INFO [Listener at localhost/35513] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44317 2023-07-24 23:06:06,654 WARN [Listener at localhost/36183] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-07-24 23:06:07,012 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1beeb00e85dd2818: Processing first storage report for DS-657865ac-cba5-4052-a8c5-c2f65745ab4f from datanode a3c71bc2-f8e3-4a26-a336-625b15361ced 2023-07-24 23:06:07,014 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1beeb00e85dd2818: from storage DS-657865ac-cba5-4052-a8c5-c2f65745ab4f node DatanodeRegistration(127.0.0.1:36733, datanodeUuid=a3c71bc2-f8e3-4a26-a336-625b15361ced, infoPort=39407, infoSecurePort=0, ipcPort=36183, storageInfo=lv=-57;cid=testClusterID;nsid=1684282051;c=1690239964205), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-07-24 23:06:07,015 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c10659e9ccc0c39: Processing first storage report for DS-0f22e8e9-9734-407c-bc72-392ba1937e0d from datanode d7990bff-f30d-439f-96fa-79a872e88701 2023-07-24 23:06:07,015 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c10659e9ccc0c39: from storage DS-0f22e8e9-9734-407c-bc72-392ba1937e0d node DatanodeRegistration(127.0.0.1:36021, datanodeUuid=d7990bff-f30d-439f-96fa-79a872e88701, infoPort=44561, infoSecurePort=0, ipcPort=35513, storageInfo=lv=-57;cid=testClusterID;nsid=1684282051;c=1690239964205), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 23:06:07,016 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xda784d6d65f1b69a: Processing first storage report for DS-92c04d7b-a571-4971-92a1-87ccd8e45199 from datanode 3b1b6036-b5b3-4b73-8b8e-9e94ff1870a5 2023-07-24 23:06:07,016 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xda784d6d65f1b69a: from storage DS-92c04d7b-a571-4971-92a1-87ccd8e45199 node DatanodeRegistration(127.0.0.1:34657, datanodeUuid=3b1b6036-b5b3-4b73-8b8e-9e94ff1870a5, infoPort=33069, infoSecurePort=0, ipcPort=38893, storageInfo=lv=-57;cid=testClusterID;nsid=1684282051;c=1690239964205), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 23:06:07,016 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x1beeb00e85dd2818: Processing first storage report for DS-b49b9aaa-616e-4e50-8613-315b87554971 from datanode a3c71bc2-f8e3-4a26-a336-625b15361ced 2023-07-24 23:06:07,016 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x1beeb00e85dd2818: from storage DS-b49b9aaa-616e-4e50-8613-315b87554971 node DatanodeRegistration(127.0.0.1:36733, datanodeUuid=a3c71bc2-f8e3-4a26-a336-625b15361ced, infoPort=39407, infoSecurePort=0, ipcPort=36183, storageInfo=lv=-57;cid=testClusterID;nsid=1684282051;c=1690239964205), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 23:06:07,017 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2c10659e9ccc0c39: Processing first storage report for DS-682e1ec3-efb3-4be2-8e3b-f63516926a76 from datanode d7990bff-f30d-439f-96fa-79a872e88701 2023-07-24 23:06:07,017 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2c10659e9ccc0c39: from storage DS-682e1ec3-efb3-4be2-8e3b-f63516926a76 node DatanodeRegistration(127.0.0.1:36021, datanodeUuid=d7990bff-f30d-439f-96fa-79a872e88701, infoPort=44561, infoSecurePort=0, ipcPort=35513, storageInfo=lv=-57;cid=testClusterID;nsid=1684282051;c=1690239964205), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 23:06:07,017 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xda784d6d65f1b69a: Processing first storage report for DS-d7d54eac-c6ab-4580-bbf5-4bd5008daeba from datanode 3b1b6036-b5b3-4b73-8b8e-9e94ff1870a5 2023-07-24 23:06:07,017 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xda784d6d65f1b69a: from storage DS-d7d54eac-c6ab-4580-bbf5-4bd5008daeba node DatanodeRegistration(127.0.0.1:34657, datanodeUuid=3b1b6036-b5b3-4b73-8b8e-9e94ff1870a5, infoPort=33069, infoSecurePort=0, ipcPort=38893, storageInfo=lv=-57;cid=testClusterID;nsid=1684282051;c=1690239964205), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-07-24 23:06:07,207 DEBUG [Listener at localhost/36183] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a 2023-07-24 23:06:07,299 INFO [Listener at localhost/36183] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/zookeeper_0, clientPort=58202, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/zookeeper_0/version-2, dataDirSize=424 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/zookeeper_0/version-2, dataLogSize=424 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, serverId=0 2023-07-24 23:06:07,322 INFO [Listener at localhost/36183] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58202 2023-07-24 23:06:07,341 INFO [Listener at localhost/36183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:07,344 INFO [Listener at localhost/36183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:08,066 INFO [Listener at localhost/36183] util.FSUtils(471): Created version file at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 with version=8 2023-07-24 23:06:08,066 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/hbase-staging 2023-07-24 23:06:08,447 INFO [Listener at localhost/36183] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-07-24 23:06:09,060 INFO [Listener at localhost/36183] client.ConnectionUtils(127): master/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 23:06:09,095 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,096 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,096 INFO [Listener at localhost/36183] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 23:06:09,096 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,096 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 23:06:09,267 INFO [Listener at localhost/36183] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 23:06:09,365 DEBUG [Listener at localhost/36183] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-07-24 23:06:09,475 INFO [Listener at localhost/36183] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40271 2023-07-24 23:06:09,488 INFO [Listener at localhost/36183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,490 INFO [Listener at localhost/36183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,513 INFO [Listener at localhost/36183] zookeeper.RecoverableZooKeeper(93): Process identifier=master:40271 connecting to ZooKeeper ensemble=127.0.0.1:58202 2023-07-24 23:06:09,573 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:402710x0, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 23:06:09,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:40271-0x1019995a32f0000 connected 2023-07-24 23:06:09,613 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 23:06:09,614 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:06:09,629 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 23:06:09,639 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40271 2023-07-24 23:06:09,640 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40271 2023-07-24 23:06:09,641 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40271 2023-07-24 23:06:09,642 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40271 2023-07-24 23:06:09,642 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40271 2023-07-24 23:06:09,651 INFO [Listener at localhost/36183] master.HMaster(444): hbase.rootdir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316, hbase.cluster.distributed=false 2023-07-24 23:06:09,724 INFO [Listener at localhost/36183] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 23:06:09,724 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,725 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,725 INFO [Listener at localhost/36183] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 23:06:09,725 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,725 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 23:06:09,731 INFO [Listener at localhost/36183] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 23:06:09,735 INFO [Listener at localhost/36183] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42121 2023-07-24 23:06:09,737 INFO [Listener at localhost/36183] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 23:06:09,749 INFO [Listener at localhost/36183] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 23:06:09,750 INFO [Listener at localhost/36183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,752 INFO [Listener at localhost/36183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,754 INFO [Listener at localhost/36183] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42121 connecting to ZooKeeper ensemble=127.0.0.1:58202 2023-07-24 23:06:09,760 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:421210x0, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 23:06:09,761 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42121-0x1019995a32f0001 connected 2023-07-24 23:06:09,761 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 23:06:09,763 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:06:09,764 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 23:06:09,764 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42121 2023-07-24 23:06:09,765 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42121 2023-07-24 23:06:09,765 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42121 2023-07-24 23:06:09,765 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42121 2023-07-24 23:06:09,766 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42121 2023-07-24 23:06:09,779 INFO [Listener at localhost/36183] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 23:06:09,779 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,779 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,780 INFO [Listener at localhost/36183] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 23:06:09,780 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,780 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 23:06:09,781 INFO [Listener at localhost/36183] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 23:06:09,783 INFO [Listener at localhost/36183] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39257 2023-07-24 23:06:09,784 INFO [Listener at localhost/36183] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 23:06:09,786 INFO [Listener at localhost/36183] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 23:06:09,787 INFO [Listener at localhost/36183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,790 INFO [Listener at localhost/36183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,791 INFO [Listener at localhost/36183] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39257 connecting to ZooKeeper ensemble=127.0.0.1:58202 2023-07-24 23:06:09,797 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:392570x0, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 23:06:09,798 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39257-0x1019995a32f0002 connected 2023-07-24 23:06:09,799 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 23:06:09,799 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:06:09,800 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 23:06:09,801 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39257 2023-07-24 23:06:09,802 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39257 2023-07-24 23:06:09,802 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39257 2023-07-24 23:06:09,807 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39257 2023-07-24 23:06:09,807 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39257 2023-07-24 23:06:09,819 INFO [Listener at localhost/36183] client.ConnectionUtils(127): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2023-07-24 23:06:09,819 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,820 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,820 INFO [Listener at localhost/36183] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-07-24 23:06:09,820 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-07-24 23:06:09,820 INFO [Listener at localhost/36183] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-07-24 23:06:09,820 INFO [Listener at localhost/36183] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-07-24 23:06:09,823 INFO [Listener at localhost/36183] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34249 2023-07-24 23:06:09,823 INFO [Listener at localhost/36183] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-07-24 23:06:09,827 INFO [Listener at localhost/36183] mob.MobFileCache(124): MobFileCache disabled 2023-07-24 23:06:09,829 INFO [Listener at localhost/36183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,831 INFO [Listener at localhost/36183] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:09,833 INFO [Listener at localhost/36183] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34249 connecting to ZooKeeper ensemble=127.0.0.1:58202 2023-07-24 23:06:09,843 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:342490x0, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-07-24 23:06:09,844 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): regionserver:342490x0, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 23:06:09,845 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): regionserver:342490x0, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:06:09,846 DEBUG [Listener at localhost/36183] zookeeper.ZKUtil(164): regionserver:342490x0, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-07-24 23:06:09,855 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34249-0x1019995a32f0003 connected 2023-07-24 23:06:09,858 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34249 2023-07-24 23:06:09,859 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34249 2023-07-24 23:06:09,861 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34249 2023-07-24 23:06:09,863 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34249 2023-07-24 23:06:09,864 DEBUG [Listener at localhost/36183] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34249 2023-07-24 23:06:09,869 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,40271,1690239968260 2023-07-24 23:06:09,881 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 23:06:09,883 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,40271,1690239968260 2023-07-24 23:06:09,912 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 23:06:09,912 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 23:06:09,913 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:09,913 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 23:06:09,913 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-07-24 23:06:09,916 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 23:06:09,922 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-07-24 23:06:09,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,40271,1690239968260 from backup master directory 2023-07-24 23:06:09,929 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,40271,1690239968260 2023-07-24 23:06:09,929 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-07-24 23:06:09,930 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 23:06:09,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,40271,1690239968260 2023-07-24 23:06:09,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-07-24 23:06:09,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-07-24 23:06:10,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/hbase.id with ID: d30ee875-059f-41e1-95e0-e53be155a5ca 2023-07-24 23:06:10,137 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-07-24 23:06:10,158 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:10,229 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x02cab362 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:10,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3361c277, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:10,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:10,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-07-24 23:06:10,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-07-24 23:06:10,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-07-24 23:06:10,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 23:06:10,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-07-24 23:06:10,331 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 23:06:10,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/data/master/store-tmp 2023-07-24 23:06:10,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:10,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 23:06:10,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:06:10,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:06:10,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 23:06:10,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:06:10,432 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:06:10,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 23:06:10,434 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/WALs/jenkins-hbase4.apache.org,40271,1690239968260 2023-07-24 23:06:10,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40271%2C1690239968260, suffix=, logDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/WALs/jenkins-hbase4.apache.org,40271,1690239968260, archiveDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/oldWALs, maxLogs=10 2023-07-24 23:06:10,534 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36021,DS-0f22e8e9-9734-407c-bc72-392ba1937e0d,DISK] 2023-07-24 23:06:10,534 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36733,DS-657865ac-cba5-4052-a8c5-c2f65745ab4f,DISK] 2023-07-24 23:06:10,534 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34657,DS-92c04d7b-a571-4971-92a1-87ccd8e45199,DISK] 2023-07-24 23:06:10,544 DEBUG [RS-EventLoopGroup-5-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:489) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:397) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-07-24 23:06:10,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/WALs/jenkins-hbase4.apache.org,40271,1690239968260/jenkins-hbase4.apache.org%2C40271%2C1690239968260.1690239970471 2023-07-24 23:06:10,633 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34657,DS-92c04d7b-a571-4971-92a1-87ccd8e45199,DISK], DatanodeInfoWithStorage[127.0.0.1:36733,DS-657865ac-cba5-4052-a8c5-c2f65745ab4f,DISK], DatanodeInfoWithStorage[127.0.0.1:36021,DS-0f22e8e9-9734-407c-bc72-392ba1937e0d,DISK]] 2023-07-24 23:06:10,634 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-07-24 23:06:10,635 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:10,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,728 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,737 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-07-24 23:06:10,771 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-07-24 23:06:10,799 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:10,815 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-07-24 23:06:10,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:10,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67950594, jitterRate=0.012542754411697388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:10,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 23:06:10,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-07-24 23:06:10,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-07-24 23:06:10,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(562): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-07-24 23:06:10,891 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-07-24 23:06:10,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(582): Recovered RegionProcedureStore lease in 1 msec 2023-07-24 23:06:10,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(596): Loaded RegionProcedureStore in 50 msec 2023-07-24 23:06:10,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-07-24 23:06:10,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-07-24 23:06:10,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-07-24 23:06:11,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-07-24 23:06:11,016 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-07-24 23:06:11,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-07-24 23:06:11,024 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-07-24 23:06:11,028 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-07-24 23:06:11,031 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:11,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-07-24 23:06:11,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-07-24 23:06:11,047 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-07-24 23:06:11,051 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 23:06:11,051 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 23:06:11,051 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 23:06:11,051 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:11,051 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-07-24 23:06:11,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,40271,1690239968260, sessionid=0x1019995a32f0000, setting cluster-up flag (Was=false) 2023-07-24 23:06:11,074 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:11,082 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-07-24 23:06:11,085 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40271,1690239968260 2023-07-24 23:06:11,091 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:11,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-07-24 23:06:11,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,40271,1690239968260 2023-07-24 23:06:11,102 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(302): Couldn't delete working snapshot directory: hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp 2023-07-24 23:06:11,171 INFO [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(951): ClusterId : d30ee875-059f-41e1-95e0-e53be155a5ca 2023-07-24 23:06:11,174 INFO [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(951): ClusterId : d30ee875-059f-41e1-95e0-e53be155a5ca 2023-07-24 23:06:11,178 INFO [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(951): ClusterId : d30ee875-059f-41e1-95e0-e53be155a5ca 2023-07-24 23:06:11,183 DEBUG [RS:2;jenkins-hbase4:34249] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 23:06:11,183 DEBUG [RS:0;jenkins-hbase4:42121] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 23:06:11,184 DEBUG [RS:1;jenkins-hbase4:39257] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-07-24 23:06:11,195 DEBUG [RS:2;jenkins-hbase4:34249] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 23:06:11,195 DEBUG [RS:2;jenkins-hbase4:34249] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 23:06:11,196 DEBUG [RS:1;jenkins-hbase4:39257] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 23:06:11,196 DEBUG [RS:1;jenkins-hbase4:39257] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 23:06:11,200 DEBUG [RS:0;jenkins-hbase4:42121] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-07-24 23:06:11,200 DEBUG [RS:0;jenkins-hbase4:42121] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-07-24 23:06:11,201 DEBUG [RS:2;jenkins-hbase4:34249] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 23:06:11,203 DEBUG [RS:1;jenkins-hbase4:39257] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 23:06:11,204 DEBUG [RS:2;jenkins-hbase4:34249] zookeeper.ReadOnlyZKClient(139): Connect 0x558881b3 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:11,205 DEBUG [RS:1;jenkins-hbase4:39257] zookeeper.ReadOnlyZKClient(139): Connect 0x217a9942 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:11,206 DEBUG [RS:0;jenkins-hbase4:42121] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-07-24 23:06:11,231 DEBUG [RS:0;jenkins-hbase4:42121] zookeeper.ReadOnlyZKClient(139): Connect 0x3298b845 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:11,245 DEBUG [RS:1;jenkins-hbase4:39257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2fbd731d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:11,247 DEBUG [RS:2;jenkins-hbase4:34249] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4b739538, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:11,247 DEBUG [RS:1;jenkins-hbase4:39257] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b82f232, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 23:06:11,247 DEBUG [RS:2;jenkins-hbase4:34249] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@dd2ebe4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 23:06:11,249 DEBUG [RS:0;jenkins-hbase4:42121] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@779a3072, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:11,249 DEBUG [RS:0;jenkins-hbase4:42121] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@49ddbccf, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 23:06:11,251 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2930): Registered master coprocessor service: service=AccessControlService 2023-07-24 23:06:11,256 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:11,257 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver loaded, priority=536870912. 2023-07-24 23:06:11,283 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:2;jenkins-hbase4:34249 2023-07-24 23:06:11,284 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:39257 2023-07-24 23:06:11,301 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42121 2023-07-24 23:06:11,304 INFO [RS:0;jenkins-hbase4:42121] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 23:06:11,304 INFO [RS:0;jenkins-hbase4:42121] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 23:06:11,304 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 23:06:11,305 INFO [RS:1;jenkins-hbase4:39257] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 23:06:11,307 INFO [RS:1;jenkins-hbase4:39257] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 23:06:11,308 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 23:06:11,308 INFO [RS:1;jenkins-hbase4:39257] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:11,308 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 23:06:11,305 INFO [RS:2;jenkins-hbase4:34249] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-07-24 23:06:11,309 INFO [RS:2;jenkins-hbase4:34249] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-07-24 23:06:11,306 INFO [RS:0;jenkins-hbase4:42121] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:11,309 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 23:06:11,312 INFO [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40271,1690239968260 with isa=jenkins-hbase4.apache.org/172.31.14.131:39257, startcode=1690239969778 2023-07-24 23:06:11,314 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(839): Registered regionserver coprocessor executorService: executorService=AccessControlService 2023-07-24 23:06:11,315 INFO [RS:2;jenkins-hbase4:34249] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:11,315 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1022): About to register with Master. 2023-07-24 23:06:11,317 INFO [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40271,1690239968260 with isa=jenkins-hbase4.apache.org/172.31.14.131:34249, startcode=1690239969818 2023-07-24 23:06:11,321 INFO [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40271,1690239968260 with isa=jenkins-hbase4.apache.org/172.31.14.131:42121, startcode=1690239969723 2023-07-24 23:06:11,339 DEBUG [RS:0;jenkins-hbase4:42121] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 23:06:11,340 DEBUG [RS:2;jenkins-hbase4:34249] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 23:06:11,341 DEBUG [RS:1;jenkins-hbase4:39257] ipc.RpcConnection(124): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-07-24 23:06:11,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-07-24 23:06:11,415 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54809, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 23:06:11,415 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55765, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 23:06:11,415 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55045, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-07-24 23:06:11,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 23:06:11,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 23:06:11,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 23:06:11,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-07-24 23:06:11,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-07-24 23:06:11,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 23:06:11,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,429 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40271] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 23:06:11,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1690240001440 2023-07-24 23:06:11,442 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40271] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 23:06:11,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-07-24 23:06:11,448 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40271] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2832) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15952) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2023-07-24 23:06:11,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-07-24 23:06:11,463 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 23:06:11,464 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-07-24 23:06:11,470 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:11,471 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-07-24 23:06:11,472 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-07-24 23:06:11,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-07-24 23:06:11,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-07-24 23:06:11,476 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 23:06:11,477 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,477 WARN [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 23:06:11,477 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 23:06:11,477 WARN [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 23:06:11,477 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(2830): Master is not running yet 2023-07-24 23:06:11,478 WARN [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1030): reportForDuty failed; sleeping 100 ms and then retrying. 2023-07-24 23:06:11,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-07-24 23:06:11,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-07-24 23:06:11,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-07-24 23:06:11,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-07-24 23:06:11,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-07-24 23:06:11,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690239971492,5,FailOnTimeoutGroup] 2023-07-24 23:06:11,494 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690239971494,5,FailOnTimeoutGroup] 2023-07-24 23:06:11,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,495 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-07-24 23:06:11,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,497 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,558 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:11,562 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:11,562 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:06:11,579 INFO [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40271,1690239968260 with isa=jenkins-hbase4.apache.org/172.31.14.131:42121, startcode=1690239969723 2023-07-24 23:06:11,579 INFO [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40271,1690239968260 with isa=jenkins-hbase4.apache.org/172.31.14.131:34249, startcode=1690239969818 2023-07-24 23:06:11,579 INFO [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(2811): reportForDuty to master=jenkins-hbase4.apache.org,40271,1690239968260 with isa=jenkins-hbase4.apache.org/172.31.14.131:39257, startcode=1690239969778 2023-07-24 23:06:11,591 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40271] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:11,606 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40271] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:11,607 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:11,606 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:06:11,608 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33513 2023-07-24 23:06:11,608 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 23:06:11,608 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=40271] master.ServerManager(394): Registering regionserver=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:11,611 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:06:11,611 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1595): Config from master: hbase.rootdir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:06:11,612 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33513 2023-07-24 23:06:11,612 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 23:06:11,611 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1595): Config from master: fs.defaultFS=hdfs://localhost:33513 2023-07-24 23:06:11,614 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1595): Config from master: hbase.master.info.port=-1 2023-07-24 23:06:11,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 23:06:11,618 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:06:11,621 DEBUG [RS:0;jenkins-hbase4:42121] zookeeper.ZKUtil(162): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:11,622 WARN [RS:0;jenkins-hbase4:42121] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 23:06:11,622 INFO [RS:0;jenkins-hbase4:42121] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 23:06:11,622 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:11,622 DEBUG [RS:1;jenkins-hbase4:39257] zookeeper.ZKUtil(162): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:11,622 WARN [RS:1;jenkins-hbase4:39257] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 23:06:11,623 INFO [RS:1;jenkins-hbase4:39257] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 23:06:11,623 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:11,624 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/info 2023-07-24 23:06:11,624 DEBUG [RS:2;jenkins-hbase4:34249] zookeeper.ZKUtil(162): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:11,624 WARN [RS:2;jenkins-hbase4:34249] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-07-24 23:06:11,624 INFO [RS:2;jenkins-hbase4:34249] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 23:06:11,624 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39257,1690239969778] 2023-07-24 23:06:11,625 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1948): logDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:11,625 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42121,1690239969723] 2023-07-24 23:06:11,625 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34249,1690239969818] 2023-07-24 23:06:11,625 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 23:06:11,633 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:11,633 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 23:06:11,640 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/rep_barrier 2023-07-24 23:06:11,640 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 23:06:11,642 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:11,642 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 23:06:11,643 DEBUG [RS:2;jenkins-hbase4:34249] zookeeper.ZKUtil(162): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:11,643 DEBUG [RS:1;jenkins-hbase4:39257] zookeeper.ZKUtil(162): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:11,644 DEBUG [RS:0;jenkins-hbase4:42121] zookeeper.ZKUtil(162): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:11,644 DEBUG [RS:2;jenkins-hbase4:34249] zookeeper.ZKUtil(162): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:11,644 DEBUG [RS:1;jenkins-hbase4:39257] zookeeper.ZKUtil(162): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:11,645 DEBUG [RS:0;jenkins-hbase4:42121] zookeeper.ZKUtil(162): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:11,645 DEBUG [RS:1;jenkins-hbase4:39257] zookeeper.ZKUtil(162): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:11,645 DEBUG [RS:2;jenkins-hbase4:34249] zookeeper.ZKUtil(162): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:11,646 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/table 2023-07-24 23:06:11,646 DEBUG [RS:0;jenkins-hbase4:42121] zookeeper.ZKUtil(162): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:11,647 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 23:06:11,650 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:11,652 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740 2023-07-24 23:06:11,653 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740 2023-07-24 23:06:11,658 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 23:06:11,663 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 23:06:11,663 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 23:06:11,664 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 23:06:11,663 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-07-24 23:06:11,679 INFO [RS:2;jenkins-hbase4:34249] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 23:06:11,679 INFO [RS:0;jenkins-hbase4:42121] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 23:06:11,685 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:11,680 INFO [RS:1;jenkins-hbase4:39257] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-07-24 23:06:11,687 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62206633, jitterRate=-0.07304893434047699}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 23:06:11,687 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 23:06:11,687 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 23:06:11,687 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 23:06:11,688 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 23:06:11,688 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 23:06:11,688 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 23:06:11,691 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 23:06:11,691 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 23:06:11,698 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-07-24 23:06:11,698 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-07-24 23:06:11,713 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-07-24 23:06:11,738 INFO [RS:2;jenkins-hbase4:34249] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 23:06:11,739 INFO [RS:0;jenkins-hbase4:42121] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 23:06:11,740 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-07-24 23:06:11,738 INFO [RS:1;jenkins-hbase4:39257] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-07-24 23:06:11,743 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-07-24 23:06:11,747 INFO [RS:2;jenkins-hbase4:34249] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 23:06:11,747 INFO [RS:1;jenkins-hbase4:39257] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 23:06:11,747 INFO [RS:2;jenkins-hbase4:34249] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,747 INFO [RS:0;jenkins-hbase4:42121] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-07-24 23:06:11,750 INFO [RS:0;jenkins-hbase4:42121] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,748 INFO [RS:1;jenkins-hbase4:39257] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,751 INFO [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 23:06:11,756 INFO [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 23:06:11,758 INFO [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer$CompactionChecker(1837): CompactionChecker runs every PT1S 2023-07-24 23:06:11,769 INFO [RS:1;jenkins-hbase4:39257] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,769 INFO [RS:2;jenkins-hbase4:34249] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,769 DEBUG [RS:2;jenkins-hbase4:34249] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,770 INFO [RS:0;jenkins-hbase4:42121] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,769 DEBUG [RS:1;jenkins-hbase4:39257] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,770 DEBUG [RS:0;jenkins-hbase4:42121] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,770 DEBUG [RS:1;jenkins-hbase4:39257] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:0;jenkins-hbase4:42121] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:1;jenkins-hbase4:39257] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:0;jenkins-hbase4:42121] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:1;jenkins-hbase4:39257] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:0;jenkins-hbase4:42121] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:1;jenkins-hbase4:39257] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:0;jenkins-hbase4:42121] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:1;jenkins-hbase4:39257] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 23:06:11,771 DEBUG [RS:0;jenkins-hbase4:42121] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 23:06:11,771 DEBUG [RS:1;jenkins-hbase4:39257] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:0;jenkins-hbase4:42121] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:1;jenkins-hbase4:39257] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:0;jenkins-hbase4:42121] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:2;jenkins-hbase4:34249] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,772 DEBUG [RS:0;jenkins-hbase4:42121] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,772 DEBUG [RS:2;jenkins-hbase4:34249] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,772 DEBUG [RS:0;jenkins-hbase4:42121] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,772 DEBUG [RS:2;jenkins-hbase4:34249] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,771 DEBUG [RS:1;jenkins-hbase4:39257] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,772 DEBUG [RS:2;jenkins-hbase4:34249] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,772 DEBUG [RS:1;jenkins-hbase4:39257] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,772 DEBUG [RS:2;jenkins-hbase4:34249] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-07-24 23:06:11,772 DEBUG [RS:2;jenkins-hbase4:34249] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,773 DEBUG [RS:2;jenkins-hbase4:34249] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,773 DEBUG [RS:2;jenkins-hbase4:34249] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,773 DEBUG [RS:2;jenkins-hbase4:34249] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-07-24 23:06:11,815 INFO [RS:1;jenkins-hbase4:39257] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,815 INFO [RS:1;jenkins-hbase4:39257] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,815 INFO [RS:1;jenkins-hbase4:39257] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,823 INFO [RS:2;jenkins-hbase4:34249] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,823 INFO [RS:0;jenkins-hbase4:42121] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,823 INFO [RS:2;jenkins-hbase4:34249] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,824 INFO [RS:0;jenkins-hbase4:42121] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,824 INFO [RS:2;jenkins-hbase4:34249] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,824 INFO [RS:0;jenkins-hbase4:42121] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,846 INFO [RS:2;jenkins-hbase4:34249] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 23:06:11,846 INFO [RS:1;jenkins-hbase4:39257] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 23:06:11,851 INFO [RS:2;jenkins-hbase4:34249] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34249,1690239969818-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,851 INFO [RS:0;jenkins-hbase4:42121] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-07-24 23:06:11,851 INFO [RS:1;jenkins-hbase4:39257] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39257,1690239969778-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,858 INFO [RS:0;jenkins-hbase4:42121] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42121,1690239969723-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:11,896 DEBUG [jenkins-hbase4:40271] assignment.AssignmentManager(2176): Processing assignQueue; systemServersCount=3, allServersCount=3 2023-07-24 23:06:11,901 DEBUG [jenkins-hbase4:40271] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:11,904 INFO [RS:1;jenkins-hbase4:39257] regionserver.Replication(203): jenkins-hbase4.apache.org,39257,1690239969778 started 2023-07-24 23:06:11,904 INFO [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,39257,1690239969778, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39257, sessionid=0x1019995a32f0002 2023-07-24 23:06:11,906 INFO [RS:2;jenkins-hbase4:34249] regionserver.Replication(203): jenkins-hbase4.apache.org,34249,1690239969818 started 2023-07-24 23:06:11,907 INFO [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,34249,1690239969818, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34249, sessionid=0x1019995a32f0003 2023-07-24 23:06:11,907 DEBUG [RS:2;jenkins-hbase4:34249] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 23:06:11,907 DEBUG [RS:2;jenkins-hbase4:34249] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:11,907 DEBUG [RS:2;jenkins-hbase4:34249] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34249,1690239969818' 2023-07-24 23:06:11,907 DEBUG [RS:2;jenkins-hbase4:34249] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 23:06:11,908 DEBUG [RS:2;jenkins-hbase4:34249] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 23:06:11,909 DEBUG [RS:2;jenkins-hbase4:34249] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 23:06:11,909 DEBUG [RS:2;jenkins-hbase4:34249] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 23:06:11,909 DEBUG [RS:1;jenkins-hbase4:39257] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 23:06:11,909 DEBUG [RS:2;jenkins-hbase4:34249] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:11,909 DEBUG [RS:1;jenkins-hbase4:39257] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:11,912 DEBUG [RS:2;jenkins-hbase4:34249] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34249,1690239969818' 2023-07-24 23:06:11,914 DEBUG [RS:2;jenkins-hbase4:34249] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:11,912 DEBUG [RS:1;jenkins-hbase4:39257] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39257,1690239969778' 2023-07-24 23:06:11,914 DEBUG [RS:1;jenkins-hbase4:39257] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 23:06:11,915 DEBUG [jenkins-hbase4:40271] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:11,915 DEBUG [jenkins-hbase4:40271] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:11,915 DEBUG [jenkins-hbase4:40271] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:11,916 DEBUG [jenkins-hbase4:40271] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:11,918 DEBUG [RS:1;jenkins-hbase4:39257] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 23:06:11,918 DEBUG [RS:2;jenkins-hbase4:34249] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:11,918 DEBUG [RS:1;jenkins-hbase4:39257] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 23:06:11,919 DEBUG [RS:1;jenkins-hbase4:39257] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 23:06:11,919 DEBUG [RS:2;jenkins-hbase4:34249] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 23:06:11,919 INFO [RS:2;jenkins-hbase4:34249] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 23:06:11,919 INFO [RS:2;jenkins-hbase4:34249] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 23:06:11,927 INFO [RS:0;jenkins-hbase4:42121] regionserver.Replication(203): jenkins-hbase4.apache.org,42121,1690239969723 started 2023-07-24 23:06:11,919 DEBUG [RS:1;jenkins-hbase4:39257] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:11,927 DEBUG [RS:1;jenkins-hbase4:39257] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39257,1690239969778' 2023-07-24 23:06:11,927 DEBUG [RS:1;jenkins-hbase4:39257] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:11,932 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39257,1690239969778, state=OPENING 2023-07-24 23:06:11,932 DEBUG [RS:1;jenkins-hbase4:39257] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:11,935 DEBUG [RS:1;jenkins-hbase4:39257] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 23:06:11,927 INFO [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1637): Serving as jenkins-hbase4.apache.org,42121,1690239969723, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42121, sessionid=0x1019995a32f0001 2023-07-24 23:06:11,935 INFO [RS:1;jenkins-hbase4:39257] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 23:06:11,943 DEBUG [RS:0;jenkins-hbase4:42121] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-07-24 23:06:11,941 INFO [RS:1;jenkins-hbase4:39257] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 23:06:11,943 DEBUG [RS:0;jenkins-hbase4:42121] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:11,943 DEBUG [RS:0;jenkins-hbase4:42121] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42121,1690239969723' 2023-07-24 23:06:11,943 DEBUG [RS:0;jenkins-hbase4:42121] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-07-24 23:06:11,946 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-07-24 23:06:11,946 DEBUG [RS:0;jenkins-hbase4:42121] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-07-24 23:06:11,947 DEBUG [RS:0;jenkins-hbase4:42121] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-07-24 23:06:11,947 DEBUG [RS:0;jenkins-hbase4:42121] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-07-24 23:06:11,947 DEBUG [RS:0;jenkins-hbase4:42121] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:11,947 DEBUG [RS:0;jenkins-hbase4:42121] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42121,1690239969723' 2023-07-24 23:06:11,947 DEBUG [RS:0;jenkins-hbase4:42121] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:11,948 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:11,948 DEBUG [RS:0;jenkins-hbase4:42121] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:11,949 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 23:06:11,953 DEBUG [RS:0;jenkins-hbase4:42121] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-07-24 23:06:11,954 INFO [RS:0;jenkins-hbase4:42121] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-07-24 23:06:11,954 INFO [RS:0;jenkins-hbase4:42121] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-07-24 23:06:11,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:06:12,031 INFO [RS:2;jenkins-hbase4:34249] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34249%2C1690239969818, suffix=, logDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,34249,1690239969818, archiveDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/oldWALs, maxLogs=32 2023-07-24 23:06:12,047 INFO [RS:1;jenkins-hbase4:39257] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39257%2C1690239969778, suffix=, logDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,39257,1690239969778, archiveDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/oldWALs, maxLogs=32 2023-07-24 23:06:12,053 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34657,DS-92c04d7b-a571-4971-92a1-87ccd8e45199,DISK] 2023-07-24 23:06:12,053 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36733,DS-657865ac-cba5-4052-a8c5-c2f65745ab4f,DISK] 2023-07-24 23:06:12,057 INFO [RS:0;jenkins-hbase4:42121] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42121%2C1690239969723, suffix=, logDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,42121,1690239969723, archiveDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/oldWALs, maxLogs=32 2023-07-24 23:06:12,060 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36021,DS-0f22e8e9-9734-407c-bc72-392ba1937e0d,DISK] 2023-07-24 23:06:12,075 INFO [RS:2;jenkins-hbase4:34249] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,34249,1690239969818/jenkins-hbase4.apache.org%2C34249%2C1690239969818.1690239972033 2023-07-24 23:06:12,078 DEBUG [RS:2;jenkins-hbase4:34249] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36733,DS-657865ac-cba5-4052-a8c5-c2f65745ab4f,DISK], DatanodeInfoWithStorage[127.0.0.1:34657,DS-92c04d7b-a571-4971-92a1-87ccd8e45199,DISK], DatanodeInfoWithStorage[127.0.0.1:36021,DS-0f22e8e9-9734-407c-bc72-392ba1937e0d,DISK]] 2023-07-24 23:06:12,087 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36021,DS-0f22e8e9-9734-407c-bc72-392ba1937e0d,DISK] 2023-07-24 23:06:12,087 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34657,DS-92c04d7b-a571-4971-92a1-87ccd8e45199,DISK] 2023-07-24 23:06:12,088 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36733,DS-657865ac-cba5-4052-a8c5-c2f65745ab4f,DISK] 2023-07-24 23:06:12,098 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36733,DS-657865ac-cba5-4052-a8c5-c2f65745ab4f,DISK] 2023-07-24 23:06:12,098 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34657,DS-92c04d7b-a571-4971-92a1-87ccd8e45199,DISK] 2023-07-24 23:06:12,098 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36021,DS-0f22e8e9-9734-407c-bc72-392ba1937e0d,DISK] 2023-07-24 23:06:12,110 INFO [RS:1;jenkins-hbase4:39257] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,39257,1690239969778/jenkins-hbase4.apache.org%2C39257%2C1690239969778.1690239972052 2023-07-24 23:06:12,110 DEBUG [RS:1;jenkins-hbase4:39257] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36021,DS-0f22e8e9-9734-407c-bc72-392ba1937e0d,DISK], DatanodeInfoWithStorage[127.0.0.1:34657,DS-92c04d7b-a571-4971-92a1-87ccd8e45199,DISK], DatanodeInfoWithStorage[127.0.0.1:36733,DS-657865ac-cba5-4052-a8c5-c2f65745ab4f,DISK]] 2023-07-24 23:06:12,111 INFO [RS:0;jenkins-hbase4:42121] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,42121,1690239969723/jenkins-hbase4.apache.org%2C42121%2C1690239969723.1690239972059 2023-07-24 23:06:12,115 DEBUG [RS:0;jenkins-hbase4:42121] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36021,DS-0f22e8e9-9734-407c-bc72-392ba1937e0d,DISK], DatanodeInfoWithStorage[127.0.0.1:34657,DS-92c04d7b-a571-4971-92a1-87ccd8e45199,DISK], DatanodeInfoWithStorage[127.0.0.1:36733,DS-657865ac-cba5-4052-a8c5-c2f65745ab4f,DISK]] 2023-07-24 23:06:12,165 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:12,168 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:06:12,173 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58678, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:06:12,192 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-07-24 23:06:12,192 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-07-24 23:06:12,197 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39257%2C1690239969778.meta, suffix=.meta, logDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,39257,1690239969778, archiveDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/oldWALs, maxLogs=32 2023-07-24 23:06:12,231 DEBUG [RS-EventLoopGroup-5-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34657,DS-92c04d7b-a571-4971-92a1-87ccd8e45199,DISK] 2023-07-24 23:06:12,233 DEBUG [RS-EventLoopGroup-5-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36733,DS-657865ac-cba5-4052-a8c5-c2f65745ab4f,DISK] 2023-07-24 23:06:12,234 DEBUG [RS-EventLoopGroup-5-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36021,DS-0f22e8e9-9734-407c-bc72-392ba1937e0d,DISK] 2023-07-24 23:06:12,244 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/WALs/jenkins-hbase4.apache.org,39257,1690239969778/jenkins-hbase4.apache.org%2C39257%2C1690239969778.meta.1690239972199.meta 2023-07-24 23:06:12,251 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34657,DS-92c04d7b-a571-4971-92a1-87ccd8e45199,DISK], DatanodeInfoWithStorage[127.0.0.1:36733,DS-657865ac-cba5-4052-a8c5-c2f65745ab4f,DISK], DatanodeInfoWithStorage[127.0.0.1:36021,DS-0f22e8e9-9734-407c-bc72-392ba1937e0d,DISK]] 2023-07-24 23:06:12,251 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-07-24 23:06:12,253 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=AccessControlService 2023-07-24 23:06:12,254 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:12,255 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-07-24 23:06:12,258 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-07-24 23:06:12,260 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-07-24 23:06:12,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-07-24 23:06:12,275 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:12,276 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-07-24 23:06:12,276 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-07-24 23:06:12,279 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-07-24 23:06:12,284 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/info 2023-07-24 23:06:12,284 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/info 2023-07-24 23:06:12,284 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-07-24 23:06:12,285 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:12,285 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-07-24 23:06:12,287 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/rep_barrier 2023-07-24 23:06:12,287 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/rep_barrier 2023-07-24 23:06:12,288 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-07-24 23:06:12,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:12,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-07-24 23:06:12,290 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/table 2023-07-24 23:06:12,290 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/table 2023-07-24 23:06:12,291 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-07-24 23:06:12,291 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:12,293 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740 2023-07-24 23:06:12,296 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740 2023-07-24 23:06:12,299 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-07-24 23:06:12,301 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-07-24 23:06:12,302 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65637322, jitterRate=-0.021927684545516968}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-07-24 23:06:12,305 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-07-24 23:06:12,315 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1690239972154 2023-07-24 23:06:12,332 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:meta,,1.1588230740 2023-07-24 23:06:12,333 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-07-24 23:06:12,334 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39257,1690239969778, state=OPEN 2023-07-24 23:06:12,341 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-07-24 23:06:12,341 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-07-24 23:06:12,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=3, resume processing ppid=2 2023-07-24 23:06:12,347 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39257,1690239969778 in 385 msec 2023-07-24 23:06:12,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=2, resume processing ppid=1 2023-07-24 23:06:12,353 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 636 msec 2023-07-24 23:06:12,360 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.0770 sec 2023-07-24 23:06:12,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1690239972360, completionTime=-1 2023-07-24 23:06:12,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(821): Finished waiting on RegionServer count=3; waited=0ms, expected min=3 server(s), max=3 server(s), master is running 2023-07-24 23:06:12,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1517): Joining cluster... 2023-07-24 23:06:12,451 DEBUG [hconnection-0x3f116f51-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:12,465 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58684, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:12,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1529): Number of RegionServers=3 2023-07-24 23:06:12,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1690240032505 2023-07-24 23:06:12,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1690240092505 2023-07-24 23:06:12,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1536): Joined the cluster in 144 msec 2023-07-24 23:06:12,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40271,1690239968260-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:12,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40271,1690239968260-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:12,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40271,1690239968260-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:12,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:40271, period=300000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:12,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-07-24 23:06:12,544 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-07-24 23:06:12,554 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-07-24 23:06:12,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:12,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-07-24 23:06:12,570 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:06:12,574 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:06:12,605 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:06:12,609 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369 empty. 2023-07-24 23:06:12,610 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:06:12,610 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-07-24 23:06:12,661 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:12,665 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => fa41a5b8df27de46cbed3841ca3a5369, NAME => 'hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:06:12,696 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:12,696 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing fa41a5b8df27de46cbed3841ca3a5369, disabling compactions & flushes 2023-07-24 23:06:12,696 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:06:12,696 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:06:12,696 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. after waiting 0 ms 2023-07-24 23:06:12,696 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:06:12,696 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:06:12,697 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for fa41a5b8df27de46cbed3841ca3a5369: 2023-07-24 23:06:12,706 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:06:12,725 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690239972710"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239972710"}]},"ts":"1690239972710"} 2023-07-24 23:06:12,762 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 23:06:12,765 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:06:12,771 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239972765"}]},"ts":"1690239972765"} 2023-07-24 23:06:12,780 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-07-24 23:06:12,784 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:12,786 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:12,786 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:12,786 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:12,786 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:12,789 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fa41a5b8df27de46cbed3841ca3a5369, ASSIGN}] 2023-07-24 23:06:12,793 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=fa41a5b8df27de46cbed3841ca3a5369, ASSIGN 2023-07-24 23:06:12,796 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=fa41a5b8df27de46cbed3841ca3a5369, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42121,1690239969723; forceNewPlan=false, retain=false 2023-07-24 23:06:12,949 INFO [jenkins-hbase4:40271] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 23:06:12,950 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fa41a5b8df27de46cbed3841ca3a5369, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:12,950 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690239972950"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239972950"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239972950"}]},"ts":"1690239972950"} 2023-07-24 23:06:12,961 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure fa41a5b8df27de46cbed3841ca3a5369, server=jenkins-hbase4.apache.org,42121,1690239969723}] 2023-07-24 23:06:13,126 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:13,126 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:06:13,130 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:06:13,137 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:06:13,137 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fa41a5b8df27de46cbed3841ca3a5369, NAME => 'hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369.', STARTKEY => '', ENDKEY => ''} 2023-07-24 23:06:13,138 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. service=AccessControlService 2023-07-24 23:06:13,139 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:13,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:06:13,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:13,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:06:13,140 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:06:13,143 INFO [StoreOpener-fa41a5b8df27de46cbed3841ca3a5369-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:06:13,145 DEBUG [StoreOpener-fa41a5b8df27de46cbed3841ca3a5369-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369/info 2023-07-24 23:06:13,145 DEBUG [StoreOpener-fa41a5b8df27de46cbed3841ca3a5369-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369/info 2023-07-24 23:06:13,146 INFO [StoreOpener-fa41a5b8df27de46cbed3841ca3a5369-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fa41a5b8df27de46cbed3841ca3a5369 columnFamilyName info 2023-07-24 23:06:13,146 INFO [StoreOpener-fa41a5b8df27de46cbed3841ca3a5369-1] regionserver.HStore(310): Store=fa41a5b8df27de46cbed3841ca3a5369/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:13,149 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:06:13,150 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:06:13,156 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:06:13,160 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:13,161 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fa41a5b8df27de46cbed3841ca3a5369; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71797844, jitterRate=0.06987124681472778}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:13,161 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fa41a5b8df27de46cbed3841ca3a5369: 2023-07-24 23:06:13,163 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369., pid=6, masterSystemTime=1690239973126 2023-07-24 23:06:13,169 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:06:13,169 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:06:13,170 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=fa41a5b8df27de46cbed3841ca3a5369, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:13,170 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1690239973170"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239973170"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239973170"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239973170"}]},"ts":"1690239973170"} 2023-07-24 23:06:13,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=6, resume processing ppid=5 2023-07-24 23:06:13,177 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure fa41a5b8df27de46cbed3841ca3a5369, server=jenkins-hbase4.apache.org,42121,1690239969723 in 213 msec 2023-07-24 23:06:13,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=5, resume processing ppid=4 2023-07-24 23:06:13,183 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=fa41a5b8df27de46cbed3841ca3a5369, ASSIGN in 388 msec 2023-07-24 23:06:13,185 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:06:13,185 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239973185"}]},"ts":"1690239973185"} 2023-07-24 23:06:13,187 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-07-24 23:06:13,191 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:06:13,194 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 635 msec 2023-07-24 23:06:13,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-07-24 23:06:13,270 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-07-24 23:06:13,270 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:13,293 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:13,297 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:13,316 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-07-24 23:06:13,340 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 23:06:13,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 44 msec 2023-07-24 23:06:13,359 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-07-24 23:06:13,372 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-07-24 23:06:13,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2023-07-24 23:06:13,387 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-07-24 23:06:13,389 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-07-24 23:06:13,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.460sec 2023-07-24 23:06:13,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-07-24 23:06:13,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-07-24 23:06:13,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-07-24 23:06:13,398 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40271,1690239968260-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-07-24 23:06:13,399 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40271,1690239968260-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-07-24 23:06:13,426 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster$4(2112): Client=null/null create 'hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-07-24 23:06:13,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1029): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:acl 2023-07-24 23:06:13,433 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:06:13,434 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:06:13,438 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:06:13,440 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d empty. 2023-07-24 23:06:13,440 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(700): Client=null/null procedure request for creating table: namespace: "hbase" qualifier: "acl" procId is: 9 2023-07-24 23:06:13,443 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:06:13,443 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:acl regions 2023-07-24 23:06:13,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 23:06:13,483 DEBUG [Listener at localhost/36183] zookeeper.ReadOnlyZKClient(139): Connect 0x0a248d85 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:13,485 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/hbase/acl/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:13,500 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(7675): creating {ENCODED => 79bf104c8199353e65a733c8164f1b5d, NAME => 'hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:acl', {NAME => 'l', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:06:13,518 DEBUG [Listener at localhost/36183] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31248683, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:13,541 DEBUG [hconnection-0x15927c21-shared-pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:13,546 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:13,547 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1604): Closing 79bf104c8199353e65a733c8164f1b5d, disabling compactions & flushes 2023-07-24 23:06:13,547 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:06:13,547 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:06:13,547 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. after waiting 0 ms 2023-07-24 23:06:13,547 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:06:13,547 INFO [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1838): Closed hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:06:13,547 DEBUG [RegionOpenAndInit-hbase:acl-pool-0] regionserver.HRegion(1558): Region close journal for 79bf104c8199353e65a733c8164f1b5d: 2023-07-24 23:06:13,553 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:06:13,555 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690239973554"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239973554"}]},"ts":"1690239973554"} 2023-07-24 23:06:13,556 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 23:06:13,557 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:13,558 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-07-24 23:06:13,559 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:06:13,560 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239973559"}]},"ts":"1690239973559"} 2023-07-24 23:06:13,560 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,40271,1690239968260 2023-07-24 23:06:13,560 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(2699): Starting mini mapreduce cluster... 2023-07-24 23:06:13,560 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/test.cache.data in system properties and HBase conf 2023-07-24 23:06:13,560 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop.tmp.dir in system properties and HBase conf 2023-07-24 23:06:13,560 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop.log.dir in system properties and HBase conf 2023-07-24 23:06:13,560 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-07-24 23:06:13,561 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-07-24 23:06:13,561 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-07-24 23:06:13,561 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-07-24 23:06:13,561 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-07-24 23:06:13,561 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-07-24 23:06:13,561 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 23:06:13,561 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-07-24 23:06:13,561 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-07-24 23:06:13,562 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-07-24 23:06:13,562 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 23:06:13,562 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-07-24 23:06:13,562 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/nfs.dump.dir in system properties and HBase conf 2023-07-24 23:06:13,562 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/java.io.tmpdir in system properties and HBase conf 2023-07-24 23:06:13,562 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-07-24 23:06:13,562 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-07-24 23:06:13,562 INFO [Listener at localhost/36183] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf 2023-07-24 23:06:13,563 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLING in hbase:meta 2023-07-24 23:06:13,569 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:13,570 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:13,571 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:13,571 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:13,571 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:13,571 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=79bf104c8199353e65a733c8164f1b5d, ASSIGN}] 2023-07-24 23:06:13,574 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:acl, region=79bf104c8199353e65a733c8164f1b5d, ASSIGN 2023-07-24 23:06:13,575 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:acl, region=79bf104c8199353e65a733c8164f1b5d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34249,1690239969818; forceNewPlan=false, retain=false 2023-07-24 23:06:13,726 INFO [jenkins-hbase4:40271] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 23:06:13,727 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=79bf104c8199353e65a733c8164f1b5d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:13,727 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690239973727"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239973727"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239973727"}]},"ts":"1690239973727"} 2023-07-24 23:06:13,732 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 79bf104c8199353e65a733c8164f1b5d, server=jenkins-hbase4.apache.org,34249,1690239969818}] 2023-07-24 23:06:13,757 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 23:06:13,892 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(712): New admin connection to jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:13,893 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:06:13,895 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:06:13,902 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:06:13,902 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 79bf104c8199353e65a733c8164f1b5d, NAME => 'hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d.', STARTKEY => '', ENDKEY => ''} 2023-07-24 23:06:13,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. service=AccessControlService 2023-07-24 23:06:13,903 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:13,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table acl 79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:06:13,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:13,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:06:13,903 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:06:13,906 INFO [StoreOpener-79bf104c8199353e65a733c8164f1b5d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family l of region 79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:06:13,909 DEBUG [StoreOpener-79bf104c8199353e65a733c8164f1b5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d/l 2023-07-24 23:06:13,909 DEBUG [StoreOpener-79bf104c8199353e65a733c8164f1b5d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d/l 2023-07-24 23:06:13,910 INFO [StoreOpener-79bf104c8199353e65a733c8164f1b5d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 79bf104c8199353e65a733c8164f1b5d columnFamilyName l 2023-07-24 23:06:13,912 INFO [StoreOpener-79bf104c8199353e65a733c8164f1b5d-1] regionserver.HStore(310): Store=79bf104c8199353e65a733c8164f1b5d/l, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:13,918 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:06:13,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:06:13,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:06:13,954 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:13,955 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 79bf104c8199353e65a733c8164f1b5d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72085541, jitterRate=0.07415826618671417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:13,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 79bf104c8199353e65a733c8164f1b5d: 2023-07-24 23:06:13,957 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d., pid=11, masterSystemTime=1690239973892 2023-07-24 23:06:13,963 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:06:13,964 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:06:13,964 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=79bf104c8199353e65a733c8164f1b5d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:13,964 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d.","families":{"info":[{"qualifier":"regioninfo","vlen":35,"tag":[],"timestamp":"1690239973964"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239973964"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239973964"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239973964"}]},"ts":"1690239973964"} 2023-07-24 23:06:13,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=11, resume processing ppid=10 2023-07-24 23:06:13,975 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 79bf104c8199353e65a733c8164f1b5d, server=jenkins-hbase4.apache.org,34249,1690239969818 in 235 msec 2023-07-24 23:06:13,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=10, resume processing ppid=9 2023-07-24 23:06:13,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:acl, region=79bf104c8199353e65a733c8164f1b5d, ASSIGN in 404 msec 2023-07-24 23:06:13,981 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:06:13,981 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:acl","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239973981"}]},"ts":"1690239973981"} 2023-07-24 23:06:13,984 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:acl, state=ENABLED in hbase:meta 2023-07-24 23:06:13,989 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:acl execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:06:13,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:acl in 562 msec 2023-07-24 23:06:14,059 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-07-24 23:06:14,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: hbase:acl, procId: 9 completed 2023-07-24 23:06:14,079 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-07-24 23:06:14,962 WARN [Thread-382] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:15,261 INFO [Thread-382] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:15,267 INFO [Thread-382] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/jobhistory to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44313_jobhistory____.l43yiq/webapp 2023-07-24 23:06:15,440 INFO [Thread-382] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices as a root resource class 2023-07-24 23:06:15,441 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver as a provider class 2023-07-24 23:06:15,441 INFO [Thread-382] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 23:06:15,443 INFO [Thread-382] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 23:06:15,512 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:15,799 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:16,173 INFO [Thread-382] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.mapreduce.v2.hs.webapp.HsWebServices to GuiceManagedComponentProvider with the scope "PerRequest" 2023-07-24 23:06:16,243 INFO [Thread-382] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44313 2023-07-24 23:06:16,462 WARN [Listener at jenkins-hbase4.apache.org/42033] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:16,869 WARN [Listener at jenkins-hbase4.apache.org/42033] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 23:06:16,870 INFO [Listener at jenkins-hbase4.apache.org/42033] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:16,878 INFO [Listener at jenkins-hbase4.apache.org/42033] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/cluster to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_44393_cluster____4801o7/webapp 2023-07-24 23:06:16,964 INFO [Listener at jenkins-hbase4.apache.org/42033] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 23:06:16,964 INFO [Listener at jenkins-hbase4.apache.org/42033] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices as a root resource class 2023-07-24 23:06:16,964 INFO [Listener at jenkins-hbase4.apache.org/42033] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 23:06:16,965 INFO [Listener at jenkins-hbase4.apache.org/42033] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 23:06:16,976 INFO [Listener at jenkins-hbase4.apache.org/42033] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:17,228 INFO [Listener at jenkins-hbase4.apache.org/42033] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:17,503 INFO [Listener at jenkins-hbase4.apache.org/42033] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.resourcemanager.webapp.RMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:17,513 INFO [Listener at jenkins-hbase4.apache.org/42033] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:44393 2023-07-24 23:06:17,999 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:06:18,122 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:acl' 2023-07-24 23:06:18,125 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-07-24 23:06:18,127 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-07-24 23:06:18,267 WARN [Listener at jenkins-hbase4.apache.org/44935] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:18,295 WARN [Listener at jenkins-hbase4.apache.org/44935] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 23:06:18,296 INFO [Listener at jenkins-hbase4.apache.org/44935] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:18,305 INFO [Listener at jenkins-hbase4.apache.org/44935] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_38855_node____kh4b69/webapp 2023-07-24 23:06:18,372 INFO [Listener at jenkins-hbase4.apache.org/44935] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 23:06:18,373 INFO [Listener at jenkins-hbase4.apache.org/44935] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 23:06:18,373 INFO [Listener at jenkins-hbase4.apache.org/44935] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 23:06:18,373 INFO [Listener at jenkins-hbase4.apache.org/44935] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 23:06:18,386 INFO [Listener at jenkins-hbase4.apache.org/44935] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,414 INFO [Listener at jenkins-hbase4.apache.org/44935] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,443 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:18,444 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.RegionServer.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionServerObservers 2023-07-24 23:06:18,444 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:18,444 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase MasterObservers 2023-07-24 23:06:18,445 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 23:06:18,445 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver Metrics about HBase MasterObservers 2023-07-24 23:06:18,445 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:18,445 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.security.access.AccessController Metrics about HBase RegionObservers 2023-07-24 23:06:18,445 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 23:06:18,445 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-07-24 23:06:18,516 INFO [Listener at jenkins-hbase4.apache.org/44935] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,531 INFO [Listener at jenkins-hbase4.apache.org/44935] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:38855 2023-07-24 23:06:18,796 WARN [Listener at jenkins-hbase4.apache.org/36985] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-07-24 23:06:18,804 WARN [Listener at jenkins-hbase4.apache.org/36985] servlet.GuiceFilter(87): Multiple Servlet injectors detected. This is a warning indicating that you have more than one GuiceFilter running in your web application. If this is deliberate, you may safely ignore this message. If this is NOT deliberate however, your application may not work as expected. 2023-07-24 23:06:18,805 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): jetty-6.1.26 2023-07-24 23:06:18,815 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-yarn-common/2.10.0/hadoop-yarn-common-2.10.0.jar!/webapps/node to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/java.io.tmpdir/Jetty_jenkins.hbase4_apache_org_36809_node____.g2x9s4/webapp 2023-07-24 23:06:18,875 INFO [Listener at jenkins-hbase4.apache.org/36985] container.GuiceComponentProviderFactory(107): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices as a root resource class 2023-07-24 23:06:18,875 INFO [Listener at jenkins-hbase4.apache.org/36985] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.webapp.GenericExceptionHandler as a provider class 2023-07-24 23:06:18,875 INFO [Listener at jenkins-hbase4.apache.org/36985] container.GuiceComponentProviderFactory(104): Registering org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver as a provider class 2023-07-24 23:06:18,875 INFO [Listener at jenkins-hbase4.apache.org/36985] application.WebApplicationImpl(791): Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM' 2023-07-24 23:06:18,884 INFO [Listener at jenkins-hbase4.apache.org/36985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.JAXBContextResolver to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,901 INFO [Listener at jenkins-hbase4.apache.org/36985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.webapp.GenericExceptionHandler to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,990 INFO [Listener at jenkins-hbase4.apache.org/36985] container.GuiceComponentProviderFactory(159): Binding org.apache.hadoop.yarn.server.nodemanager.webapp.NMWebServices to GuiceManagedComponentProvider with the scope "Singleton" 2023-07-24 23:06:18,999 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:36809 2023-07-24 23:06:19,031 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2726): Mini mapreduce cluster started 2023-07-24 23:06:19,032 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:19,111 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=706, OpenFileDescriptor=900, MaxFileDescriptor=60000, SystemLoadAverage=344, ProcessCount=175, AvailableMemoryMB=7711 2023-07-24 23:06:19,111 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=706 is superior to 500 2023-07-24 23:06:19,125 DEBUG [Listener at jenkins-hbase4.apache.org/36985] ipc.RpcConnection(124): Using SIMPLE authentication for service=MasterService, sasl=false 2023-07-24 23:06:19,131 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50972, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-07-24 23:06:19,139 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 23:06:19,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:19,144 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:06:19,145 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportWithTargetName" procId is: 12 2023-07-24 23:06:19,148 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:06:19,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 23:06:19,153 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:19,154 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:19,155 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0 empty. 2023-07-24 23:06:19,157 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487 empty. 2023-07-24 23:06:19,157 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:19,158 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:19,158 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 23:06:19,193 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:19,195 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(7675): creating {ENCODED => 433c6f439e02e0cd0d221cd7669daec0, NAME => 'testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:06:19,195 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(7675): creating {ENCODED => c0c21dfe561bf83984edbd187c53a487, NAME => 'testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportWithTargetName', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:06:19,236 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:19,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:19,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1604): Closing 433c6f439e02e0cd0d221cd7669daec0, disabling compactions & flushes 2023-07-24 23:06:19,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1604): Closing c0c21dfe561bf83984edbd187c53a487, disabling compactions & flushes 2023-07-24 23:06:19,237 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:19,237 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:19,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:19,237 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:19,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. after waiting 0 ms 2023-07-24 23:06:19,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. after waiting 0 ms 2023-07-24 23:06:19,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:19,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:19,238 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:19,238 INFO [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:19,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-1] regionserver.HRegion(1558): Region close journal for c0c21dfe561bf83984edbd187c53a487: 2023-07-24 23:06:19,238 DEBUG [RegionOpenAndInit-testtb-testExportWithTargetName-pool-0] regionserver.HRegion(1558): Region close journal for 433c6f439e02e0cd0d221cd7669daec0: 2023-07-24 23:06:19,245 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:06:19,246 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239979246"}]},"ts":"1690239979246"} 2023-07-24 23:06:19,246 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979246"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239979246"}]},"ts":"1690239979246"} 2023-07-24 23:06:19,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 23:06:19,297 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:06:19,299 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:06:19,299 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239979299"}]},"ts":"1690239979299"} 2023-07-24 23:06:19,302 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLING in hbase:meta 2023-07-24 23:06:19,308 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:19,310 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:19,310 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:19,310 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:19,310 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:19,311 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=433c6f439e02e0cd0d221cd7669daec0, ASSIGN}, {pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c0c21dfe561bf83984edbd187c53a487, ASSIGN}] 2023-07-24 23:06:19,314 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c0c21dfe561bf83984edbd187c53a487, ASSIGN 2023-07-24 23:06:19,314 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=433c6f439e02e0cd0d221cd7669daec0, ASSIGN 2023-07-24 23:06:19,316 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=14, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c0c21dfe561bf83984edbd187c53a487, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39257,1690239969778; forceNewPlan=false, retain=false 2023-07-24 23:06:19,316 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=433c6f439e02e0cd0d221cd7669daec0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42121,1690239969723; forceNewPlan=false, retain=false 2023-07-24 23:06:19,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 23:06:19,467 INFO [jenkins-hbase4:40271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:06:19,469 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c0c21dfe561bf83984edbd187c53a487, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:19,469 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=433c6f439e02e0cd0d221cd7669daec0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:19,469 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239979469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239979469"}]},"ts":"1690239979469"} 2023-07-24 23:06:19,469 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979469"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239979469"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239979469"}]},"ts":"1690239979469"} 2023-07-24 23:06:19,472 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE; OpenRegionProcedure c0c21dfe561bf83984edbd187c53a487, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:06:19,474 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=16, ppid=13, state=RUNNABLE; OpenRegionProcedure 433c6f439e02e0cd0d221cd7669daec0, server=jenkins-hbase4.apache.org,42121,1690239969723}] 2023-07-24 23:06:19,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:19,631 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:19,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 433c6f439e02e0cd0d221cd7669daec0, NAME => 'testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:06:19,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c0c21dfe561bf83984edbd187c53a487, NAME => 'testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:06:19,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. service=AccessControlService 2023-07-24 23:06:19,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. service=AccessControlService 2023-07-24 23:06:19,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:19,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName 433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:19,632 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:19,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:19,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:19,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportWithTargetName c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:19,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:19,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:19,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:19,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:19,636 INFO [StoreOpener-433c6f439e02e0cd0d221cd7669daec0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:19,636 INFO [StoreOpener-c0c21dfe561bf83984edbd187c53a487-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:19,639 DEBUG [StoreOpener-c0c21dfe561bf83984edbd187c53a487-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/cf 2023-07-24 23:06:19,639 DEBUG [StoreOpener-c0c21dfe561bf83984edbd187c53a487-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/cf 2023-07-24 23:06:19,639 DEBUG [StoreOpener-433c6f439e02e0cd0d221cd7669daec0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/cf 2023-07-24 23:06:19,639 DEBUG [StoreOpener-433c6f439e02e0cd0d221cd7669daec0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/cf 2023-07-24 23:06:19,643 INFO [StoreOpener-c0c21dfe561bf83984edbd187c53a487-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c0c21dfe561bf83984edbd187c53a487 columnFamilyName cf 2023-07-24 23:06:19,643 INFO [StoreOpener-433c6f439e02e0cd0d221cd7669daec0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 433c6f439e02e0cd0d221cd7669daec0 columnFamilyName cf 2023-07-24 23:06:19,648 INFO [StoreOpener-c0c21dfe561bf83984edbd187c53a487-1] regionserver.HStore(310): Store=c0c21dfe561bf83984edbd187c53a487/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:19,650 INFO [StoreOpener-433c6f439e02e0cd0d221cd7669daec0-1] regionserver.HStore(310): Store=433c6f439e02e0cd0d221cd7669daec0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:19,653 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:19,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:19,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:19,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:19,663 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:19,664 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:19,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:19,680 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c0c21dfe561bf83984edbd187c53a487; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72144702, jitterRate=0.0750398337841034}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:19,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c0c21dfe561bf83984edbd187c53a487: 2023-07-24 23:06:19,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:19,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 433c6f439e02e0cd0d221cd7669daec0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67937920, jitterRate=0.012353897094726562}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:19,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 433c6f439e02e0cd0d221cd7669daec0: 2023-07-24 23:06:19,683 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487., pid=15, masterSystemTime=1690239979625 2023-07-24 23:06:19,684 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0., pid=16, masterSystemTime=1690239979626 2023-07-24 23:06:19,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:19,686 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:19,687 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=14 updating hbase:meta row=c0c21dfe561bf83984edbd187c53a487, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:19,687 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979687"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239979687"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239979687"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239979687"}]},"ts":"1690239979687"} 2023-07-24 23:06:19,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:19,688 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:19,688 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=433c6f439e02e0cd0d221cd7669daec0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:19,693 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239979688"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239979688"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239979688"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239979688"}]},"ts":"1690239979688"} 2023-07-24 23:06:19,703 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=15, resume processing ppid=14 2023-07-24 23:06:19,704 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=15, ppid=14, state=SUCCESS; OpenRegionProcedure c0c21dfe561bf83984edbd187c53a487, server=jenkins-hbase4.apache.org,39257,1690239969778 in 224 msec 2023-07-24 23:06:19,705 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=16, resume processing ppid=13 2023-07-24 23:06:19,707 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=16, ppid=13, state=SUCCESS; OpenRegionProcedure 433c6f439e02e0cd0d221cd7669daec0, server=jenkins-hbase4.apache.org,42121,1690239969723 in 224 msec 2023-07-24 23:06:19,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=14, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c0c21dfe561bf83984edbd187c53a487, ASSIGN in 392 msec 2023-07-24 23:06:19,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=13, resume processing ppid=12 2023-07-24 23:06:19,711 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=433c6f439e02e0cd0d221cd7669daec0, ASSIGN in 396 msec 2023-07-24 23:06:19,713 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:06:19,713 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239979713"}]},"ts":"1690239979713"} 2023-07-24 23:06:19,715 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=ENABLED in hbase:meta 2023-07-24 23:06:19,718 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportWithTargetName execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:06:19,723 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportWithTargetName jenkins: RWXCA 2023-07-24 23:06:19,730 DEBUG [PEWorker-2] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:19,735 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:19,739 DEBUG [hconnection-0x615ac902-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:19,742 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.2 (auth:SIMPLE), service=ClientService 2023-07-24 23:06:19,752 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 23:06:19,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 23:06:19,787 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:19,787 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:19,787 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:19,787 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:19,787 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:06:19,794 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:19,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:19,795 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:19,796 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data PBUF\x0AE\x0A\x07jenkins\x12:\x08\x03"6\x0A*\x0A\x07default\x12\x1Ftesttb-testExportWithTargetName \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:19,803 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=12, state=SUCCESS; CreateTableProcedure table=testtb-testExportWithTargetName in 656 msec 2023-07-24 23:06:20,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2023-07-24 23:06:20,256 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportWithTargetName, procId: 12 completed 2023-07-24 23:06:20,262 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 23:06:20,263 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:20,266 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:20,316 DEBUG [hconnection-0x15927c21-shared-pool-4] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:20,320 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54034, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:20,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:20,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690239980346 (current time:1690239980346). 2023-07-24 23:06:20,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:20,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x6ec8dccb to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:20,354 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29d20cea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:20,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:20,359 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60708, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:20,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6ec8dccb to 127.0.0.1:58202 2023-07-24 23:06:20,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:20,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x62d15aa6 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:20,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@b19f686, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:20,382 DEBUG [hconnection-0x3c759be2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:20,384 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60716, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:20,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:20,394 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:20,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x62d15aa6 to 127.0.0.1:58202 2023-07-24 23:06:20,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:20,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 23:06:20,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:20,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:20,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:20,461 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=17, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:20,463 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=17, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690240580463 2023-07-24 23:06:20,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:20,472 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 23:06:20,475 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=17, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:20,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=17, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 27 msec 2023-07-24 23:06:20,482 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:20,484 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:20,487 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:20,487 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:20,488 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690240580488 2023-07-24 23:06:20,529 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,543 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportWithTargetName' 2023-07-24 23:06:20,543 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:20,544 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 23:06:20,544 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 23:06:20,545 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,545 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,550 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,550 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,550 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,552 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 23:06:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,553 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 23:06:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 171 2023-07-24 23:06:20,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,553 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:20,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:20,553 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:20,558 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,558 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,558 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,559 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,559 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:20,570 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,571 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,571 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:20,571 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:20,571 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:20,571 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:20,580 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:20,580 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:20,581 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:20,581 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:20,582 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:20,582 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:20,582 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:20,584 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:20,582 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (emptySnaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:20,587 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:20,589 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,589 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:20,590 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,590 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:20,591 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,591 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:20,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:20,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:20,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:20,594 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:20,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,595 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,595 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,596 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,596 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:20,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,598 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,598 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,598 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:20,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 23:06:20,599 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f5535c0[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:20,599 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:20,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:20,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:20,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,603 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:20,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure 'emptySnaptb0-testExportWithTargetName' on coordinator 2023-07-24 23:06:20,604 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2f5535c0[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:20,604 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 23:06:20,604 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,608 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,608 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,608 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,608 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:20,608 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:06:20,609 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:20,611 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,618 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:20,619 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:20,619 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:20,619 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. started... 2023-07-24 23:06:20,624 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,625 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:20,627 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 433c6f439e02e0cd0d221cd7669daec0: 2023-07-24 23:06:20,628 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:20,628 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:20,628 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:20,628 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,636 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:20,636 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:20,636 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:20,636 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. started... 2023-07-24 23:06:20,639 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:20,645 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c0c21dfe561bf83984edbd187c53a487: 2023-07-24 23:06:20,646 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,646 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:20,648 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:20,648 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:20,735 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. completed. 2023-07-24 23:06:20,735 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:20,736 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. completed. 2023-07-24 23:06:20,736 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:20,736 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:20,736 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:20,736 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:20,736 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:20,736 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,736 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,736 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:20,736 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:20,736 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:06:20,737 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:06:20,739 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,739 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:20,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:20,739 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:20,739 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,739 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:20,739 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:20,741 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:20,741 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:20,739 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:20,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:20,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:20,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,746 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:20,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:06:20,751 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 23:06:20,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:20,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:20,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:20,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:20,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:20,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,755 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42121,1690239969723': 2023-07-24 23:06:20,756 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' released barrier for procedure'emptySnaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 23:06:20,756 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportWithTargetName' execution completed 2023-07-24 23:06:20,756 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:20,756 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:20,756 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,757 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:20,761 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,761 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,761 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,761 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,761 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:20,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:20,761 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,761 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,762 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:20,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,763 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,764 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,766 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:20,768 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:20,771 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,772 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,773 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,793 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,793 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,793 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,793 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,793 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,793 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,793 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,793 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,794 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,794 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:20,794 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,794 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:20,794 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:20,794 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,794 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,794 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:20,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,795 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:20,795 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:20,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:20,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:20,795 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:20,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,795 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 23:06:20,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,797 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:06:20,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:20,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:20,798 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:20,798 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:20,798 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:06:20,801 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 23:06:20,861 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,864 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,950 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,991 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 23:06:20,991 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,992 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:20,992 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690239980472Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690239980861 (+389 ms)Consolidate snapshot: emptySnaptb0-testExportWithTargetName at 1690239980861Loading Region manifests for emptySnaptb0-testExportWithTargetName at 1690239980861Writing data manifest for emptySnaptb0-testExportWithTargetName at 1690239980880 (+19 ms)Verifying snapshot: emptySnaptb0-testExportWithTargetName at 1690239980937 (+57 ms)Snapshot emptySnaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690239980991 (+54 ms) 2023-07-24 23:06:20,994 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:20,996 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 515 msec 2023-07-24 23:06:21,099 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:21,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:21,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:21,119 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42121] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:21,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39257] regionserver.HRegion(8805): writing data to region testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:21,127 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportWithTargetName 2023-07-24 23:06:21,127 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:21,127 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:21,146 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:21,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690239981146 (current time:1690239981146). 2023-07-24 23:06:21,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:21,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x785b1a75 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:21,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d24e6ab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:21,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:21,160 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60732, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:21,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x785b1a75 to 127.0.0.1:58202 2023-07-24 23:06:21,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:21,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x12c1388a to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:21,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32690015, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:21,171 DEBUG [hconnection-0x5892a94d-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:21,175 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60738, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:21,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:21,184 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39864, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:21,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x12c1388a to 127.0.0.1:58202 2023-07-24 23:06:21,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:21,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testExportWithTargetName], kv [jenkins: RWXCA] 2023-07-24 23:06:21,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:21,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:21,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:21,192 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=19, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:21,194 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=19, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE; timeout=600000, timestamp=1690240581194 2023-07-24 23:06:21,194 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName 2023-07-24 23:06:21,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } 2023-07-24 23:06:21,196 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:21,196 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:21,198 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:21,198 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=19, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE 2023-07-24 23:06:21,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=19, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=EXCLUSIVE in 9 msec 2023-07-24 23:06:21,201 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=20, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:21,201 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=20, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED; timeout=600000, timestamp=1690240581201 2023-07-24 23:06:21,223 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportWithTargetName 2023-07-24 23:06:21,223 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportWithTargetName' 2023-07-24 23:06:21,223 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:21,225 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportWithTargetName' starting 'acquire' 2023-07-24 23:06:21,225 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportWithTargetName', kicking off acquire phase on members. 2023-07-24 23:06:21,225 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,225 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,230 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:21,230 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:21,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:21,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:21,230 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:21,230 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:21,230 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:21,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:21,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:21,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:21,230 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:21,230 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:21,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,231 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:21,231 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:21,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,231 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 166 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportWithTargetName from table testtb-testExportWithTargetName type FLUSH 2023-07-24 23:06:21,232 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:21,232 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:21,232 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 23:06:21,233 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:21,234 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:21,234 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:21,234 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:21,234 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportWithTargetName 2023-07-24 23:06:21,234 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:21,234 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportWithTargetName' with timeout 300000ms 2023-07-24 23:06:21,235 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:21,235 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:21,235 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:21,235 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportWithTargetName' starting 'acquire' stage 2023-07-24 23:06:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportWithTargetName' locally acquired 2023-07-24 23:06:21,236 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (snaptb0-testExportWithTargetName) in zk 2023-07-24 23:06:21,238 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,238 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:21,238 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:21,239 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,239 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:21,239 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,240 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:21,240 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,240 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:21,240 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:21,240 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,240 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportWithTargetName' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:21,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:21,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:21,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:21,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 23:06:21,242 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f428b[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:21,242 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:21,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:21,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:21,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:21,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:21,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:21,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:21,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:21,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure 'snaptb0-testExportWithTargetName' on coordinator 2023-07-24 23:06:21,245 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19f428b[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:21,245 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportWithTargetName' starting 'in-barrier' execution. 2023-07-24 23:06:21,245 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,251 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,251 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,252 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:21,251 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,252 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:21,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,252 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:21,252 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:21,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:21,252 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:21,252 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:21,252 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:21,253 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:21,252 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:06:21,253 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. started... 2023-07-24 23:06:21,252 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:21,252 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportWithTargetName' received 'reached' from coordinator. 2023-07-24 23:06:21,253 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 433c6f439e02e0cd0d221cd7669daec0 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 23:06:21,253 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:21,253 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:21,253 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:21,253 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. started... 2023-07-24 23:06:21,254 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c0c21dfe561bf83984edbd187c53a487 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 23:06:21,257 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:21,257 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:21,257 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:21,297 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:21,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:21,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:21,304 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:21,434 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307244811bbfd2d99489f8764faec9c1289d6 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307244811bbfd2d99489f8764faec9c1289d6 2023-07-24 23:06:21,434 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307244b8b76a3afd94338a24cc1e54ecc580d to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307244b8b76a3afd94338a24cc1e54ecc580d 2023-07-24 23:06:21,504 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:21,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:21,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:21,509 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:06:21,809 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:21,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:21,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:21,811 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 23:06:21,889 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/.tmp/cf/878f01bcb7c947c1bbc9b0b1b0c17a9c 2023-07-24 23:06:21,889 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/.tmp/cf/d3843bc867474f4ebe6cb02babc992a6 2023-07-24 23:06:21,902 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/.tmp/cf/d3843bc867474f4ebe6cb02babc992a6 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/cf/d3843bc867474f4ebe6cb02babc992a6 2023-07-24 23:06:21,908 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/.tmp/cf/878f01bcb7c947c1bbc9b0b1b0c17a9c as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/cf/878f01bcb7c947c1bbc9b0b1b0c17a9c 2023-07-24 23:06:21,915 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/cf/d3843bc867474f4ebe6cb02babc992a6, entries=48, sequenceid=6, filesize=13.0 K 2023-07-24 23:06:21,919 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for c0c21dfe561bf83984edbd187c53a487 in 665ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:21,920 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportWithTargetName' 2023-07-24 23:06:21,921 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c0c21dfe561bf83984edbd187c53a487: 2023-07-24 23:06:21,921 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 23:06:21,921 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:21,922 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/cf/d3843bc867474f4ebe6cb02babc992a6] hfiles 2023-07-24 23:06:21,922 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/cf/d3843bc867474f4ebe6cb02babc992a6 for snapshot=snaptb0-testExportWithTargetName 2023-07-24 23:06:21,923 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/cf/878f01bcb7c947c1bbc9b0b1b0c17a9c, entries=2, sequenceid=6, filesize=5.2 K 2023-07-24 23:06:21,929 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 433c6f439e02e0cd0d221cd7669daec0 in 676ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:21,930 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 433c6f439e02e0cd0d221cd7669daec0: 2023-07-24 23:06:21,930 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 23:06:21,931 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:21,931 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/cf/878f01bcb7c947c1bbc9b0b1b0c17a9c] hfiles 2023-07-24 23:06:21,931 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/cf/878f01bcb7c947c1bbc9b0b1b0c17a9c for snapshot=snaptb0-testExportWithTargetName 2023-07-24 23:06:22,022 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. completed. 2023-07-24 23:06:22,022 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:22,022 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. completed. 2023-07-24 23:06:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:22,022 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,022 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:06:22,023 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportWithTargetName' locally completed 2023-07-24 23:06:22,023 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportWithTargetName' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:06:22,025 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,025 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:22,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:22,025 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:22,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:22,025 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportWithTargetName' has notified controller of completion 2023-07-24 23:06:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:22,026 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportWithTargetName' completed. 2023-07-24 23:06:22,027 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:22,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:22,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:22,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:22,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:22,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:06:22,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 1 more 2023-07-24 23:06:22,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:22,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:22,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:22,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:22,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:22,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:22,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:22,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:22,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportWithTargetName' member 'jenkins-hbase4.apache.org,42121,1690239969723': 2023-07-24 23:06:22,043 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' released barrier for procedure'snaptb0-testExportWithTargetName', counting down latch. Waiting for 0 more 2023-07-24 23:06:22,043 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportWithTargetName' execution completed 2023-07-24 23:06:22,044 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:22,044 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:22,044 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportWithTargetName 2023-07-24 23:06:22,044 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportWithTargetNameincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:22,046 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,046 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:22,046 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,046 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,046 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:22,046 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:22,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,046 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:22,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:22,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:22,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:22,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:22,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:22,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:22,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:22,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,049 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:22,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:22,051 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:22,052 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:22,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:22,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:22,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:22,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportWithTargetName 2023-07-24 23:06:22,057 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,059 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,059 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,062 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:22,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:22,078 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:22,078 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:22,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:22,078 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:22,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportWithTargetName 2023-07-24 23:06:22,078 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:22,078 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportWithTargetName 2023-07-24 23:06:22,078 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:22,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 90c8eeaaf01a24f585da11044309be71, NAME => 'testtb-testExportWithTargetName,.mob,0.90c8eeaaf01a24f585da11044309be71.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportWithTargetName 2023-07-24 23:06:22,078 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,078 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:06:22,078 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:22,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:22,078 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:22,078 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:22,079 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:22,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:22,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:22,079 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:22,078 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,080 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:22,080 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:22,081 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307244b8b76a3afd94338a24cc1e54ecc580d, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307244811bbfd2d99489f8764faec9c1289d6] mob files 2023-07-24 23:06:22,081 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:22,081 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307244b8b76a3afd94338a24cc1e54ecc580d 2023-07-24 23:06:22,081 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,082 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307244811bbfd2d99489f8764faec9c1289d6 2023-07-24 23:06:22,082 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:22,082 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:22,082 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:22,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:22,082 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,082 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,083 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:22,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:22,112 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportWithTargetName 2023-07-24 23:06:22,113 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,153 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,204 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed 2023-07-24 23:06:22,204 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,205 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportWithTargetName 2023-07-24 23:06:22,205 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportWithTargetName C_M_SNAPSHOT_TABLE on table testtb-testExportWithTargetName at 1690239981194Completed referencing HFiles for the mob region of table: testtb-testExportWithTargetName at 1690239982112 (+918 ms)Consolidate snapshot: snaptb0-testExportWithTargetName at 1690239982112Loading Region manifests for snaptb0-testExportWithTargetName at 1690239982112Writing data manifest for snaptb0-testExportWithTargetName at 1690239982120 (+8 ms)Verifying snapshot: snaptb0-testExportWithTargetName at 1690239982141 (+21 ms)Snapshot snaptb0-testExportWithTargetName of table testtb-testExportWithTargetName completed at 1690239982204 (+63 ms) 2023-07-24 23:06:22,206 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=20, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED 2023-07-24 23:06:22,209 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=20, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportWithTargetName, type=SHARED in 1.0110 sec 2023-07-24 23:06:22,312 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:22,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 } is done 2023-07-24 23:06:22,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportWithTargetName table=testtb-testExportWithTargetName type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:22,320 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239982320 2023-07-24 23:06:22,320 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33513, tgtDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239982320, rawTgtDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239982320, srcFsUri=hdfs://localhost:33513, srcDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:06:22,389 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:06:22,389 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-16775830_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239982320, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239982320/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 23:06:22,389 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316, snapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportWithTargetName. 2023-07-24 23:06:22,435 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportWithTargetName to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239982320/.hbase-snapshot/.tmp/testExportWithTargetName 2023-07-24 23:06:22,940 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:22,941 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:22,941 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:22,942 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:22,942 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:22,943 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:22,943 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:23,025 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop-8229288277480468803.jar 2023-07-24 23:06:23,026 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:23,027 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:23,027 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:23,027 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:23,028 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:23,028 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:23,029 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:06:23,029 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:06:23,030 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:06:23,030 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:06:23,030 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:06:23,031 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:06:23,031 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:06:23,032 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:06:23,032 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:06:23,033 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:06:23,036 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:23,036 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:23,037 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:23,037 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:23,037 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:23,038 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:23,038 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:24,043 WARN [Listener at jenkins-hbase4.apache.org/36985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:06:24,049 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportWithTargetName' hfile list 2023-07-24 23:06:24,058 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 23:06:24,617 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:24,619 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:24,869 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0001_000001 (auth:SIMPLE) 2023-07-24 23:06:25,145 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:06:30,117 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0001_000001 (auth:SIMPLE) 2023-07-24 23:06:32,398 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0001_000001 (auth:SIMPLE) 2023-07-24 23:06:35,662 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0001_000001 (auth:SIMPLE) 2023-07-24 23:06:37,038 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:06:37,047 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:06:37,066 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1127): Export Completed: testExportWithTargetName 2023-07-24 23:06:37,066 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:06:37,067 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:06:37,067 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportWithTargetName at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportWithTargetName 2023-07-24 23:06:37,068 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportWithTargetName/.snapshotinfo 2023-07-24 23:06:37,068 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportWithTargetName/data.manifest 2023-07-24 23:06:37,068 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239982320/.hbase-snapshot/testExportWithTargetName at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239982320/.hbase-snapshot/testExportWithTargetName 2023-07-24 23:06:37,069 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239982320/.hbase-snapshot/testExportWithTargetName/.snapshotinfo 2023-07-24 23:06:37,069 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239982320/.hbase-snapshot/testExportWithTargetName/data.manifest 2023-07-24 23:06:37,080 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$15(890): Started disable of testtb-testExportWithTargetName 2023-07-24 23:06:37,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportWithTargetName 2023-07-24 23:06:37,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=21, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:37,098 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239997098"}]},"ts":"1690239997098"} 2023-07-24 23:06:37,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 23:06:37,101 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLING in hbase:meta 2023-07-24 23:06:37,103 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportWithTargetName to state=DISABLING 2023-07-24 23:06:37,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=433c6f439e02e0cd0d221cd7669daec0, UNASSIGN}, {pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c0c21dfe561bf83984edbd187c53a487, UNASSIGN}] 2023-07-24 23:06:37,107 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=22, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=433c6f439e02e0cd0d221cd7669daec0, UNASSIGN 2023-07-24 23:06:37,107 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=21, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c0c21dfe561bf83984edbd187c53a487, UNASSIGN 2023-07-24 23:06:37,108 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=433c6f439e02e0cd0d221cd7669daec0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:37,108 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239997108"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239997108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239997108"}]},"ts":"1690239997108"} 2023-07-24 23:06:37,109 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c0c21dfe561bf83984edbd187c53a487, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:37,109 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239997108"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239997108"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239997108"}]},"ts":"1690239997108"} 2023-07-24 23:06:37,111 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=24, ppid=22, state=RUNNABLE; CloseRegionProcedure 433c6f439e02e0cd0d221cd7669daec0, server=jenkins-hbase4.apache.org,42121,1690239969723}] 2023-07-24 23:06:37,113 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; CloseRegionProcedure c0c21dfe561bf83984edbd187c53a487, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:06:37,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 23:06:37,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:37,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:37,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 433c6f439e02e0cd0d221cd7669daec0, disabling compactions & flushes 2023-07-24 23:06:37,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c0c21dfe561bf83984edbd187c53a487, disabling compactions & flushes 2023-07-24 23:06:37,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:37,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:37,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:37,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:37,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. after waiting 0 ms 2023-07-24 23:06:37,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:37,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. after waiting 0 ms 2023-07-24 23:06:37,272 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:37,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:06:37,285 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:06:37,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:37,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:37,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0. 2023-07-24 23:06:37,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487. 2023-07-24 23:06:37,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 433c6f439e02e0cd0d221cd7669daec0: 2023-07-24 23:06:37,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c0c21dfe561bf83984edbd187c53a487: 2023-07-24 23:06:37,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:37,291 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=22 updating hbase:meta row=433c6f439e02e0cd0d221cd7669daec0, regionState=CLOSED 2023-07-24 23:06:37,291 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239997291"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239997291"}]},"ts":"1690239997291"} 2023-07-24 23:06:37,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:37,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=c0c21dfe561bf83984edbd187c53a487, regionState=CLOSED 2023-07-24 23:06:37,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1690239997291"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239997291"}]},"ts":"1690239997291"} 2023-07-24 23:06:37,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=24, resume processing ppid=22 2023-07-24 23:06:37,296 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=24, ppid=22, state=SUCCESS; CloseRegionProcedure 433c6f439e02e0cd0d221cd7669daec0, server=jenkins-hbase4.apache.org,42121,1690239969723 in 182 msec 2023-07-24 23:06:37,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=25, resume processing ppid=23 2023-07-24 23:06:37,297 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=25, ppid=23, state=SUCCESS; CloseRegionProcedure c0c21dfe561bf83984edbd187c53a487, server=jenkins-hbase4.apache.org,39257,1690239969778 in 181 msec 2023-07-24 23:06:37,298 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=22, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=433c6f439e02e0cd0d221cd7669daec0, UNASSIGN in 191 msec 2023-07-24 23:06:37,299 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=23, resume processing ppid=21 2023-07-24 23:06:37,300 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=23, ppid=21, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportWithTargetName, region=c0c21dfe561bf83984edbd187c53a487, UNASSIGN in 192 msec 2023-07-24 23:06:37,300 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239997300"}]},"ts":"1690239997300"} 2023-07-24 23:06:37,302 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportWithTargetName, state=DISABLED in hbase:meta 2023-07-24 23:06:37,303 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportWithTargetName to state=DISABLED 2023-07-24 23:06:37,306 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=21, state=SUCCESS; DisableTableProcedure table=testtb-testExportWithTargetName in 216 msec 2023-07-24 23:06:37,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2023-07-24 23:06:37,403 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportWithTargetName, procId: 21 completed 2023-07-24 23:06:37,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportWithTargetName 2023-07-24 23:06:37,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:37,420 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=26, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:37,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportWithTargetName 2023-07-24 23:06:37,423 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=26, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:37,426 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportWithTargetName 2023-07-24 23:06:37,428 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 23:06:37,428 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 23:06:37,428 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 23:06:37,428 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportWithTargetName 2023-07-24 23:06:37,429 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:37,429 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:37,431 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:37,431 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:37,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 23:06:37,432 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:37,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 23:06:37,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 23:06:37,432 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:06:37,432 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:06:37,432 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:37,432 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportWithTargetName with data null 2023-07-24 23:06:37,432 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:06:37,432 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:06:37,433 DEBUG [HFileArchiver-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/recovered.edits] 2023-07-24 23:06:37,434 DEBUG [HFileArchiver-6] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/recovered.edits] 2023-07-24 23:06:37,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 23:06:37,441 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/cf/878f01bcb7c947c1bbc9b0b1b0c17a9c to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/cf/878f01bcb7c947c1bbc9b0b1b0c17a9c 2023-07-24 23:06:37,441 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/cf/d3843bc867474f4ebe6cb02babc992a6 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/cf/d3843bc867474f4ebe6cb02babc992a6 2023-07-24 23:06:37,445 DEBUG [HFileArchiver-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0/recovered.edits/9.seqid 2023-07-24 23:06:37,445 DEBUG [HFileArchiver-6] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487/recovered.edits/9.seqid 2023-07-24 23:06:37,446 DEBUG [HFileArchiver-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/433c6f439e02e0cd0d221cd7669daec0 2023-07-24 23:06:37,446 DEBUG [HFileArchiver-6] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportWithTargetName/c0c21dfe561bf83984edbd187c53a487 2023-07-24 23:06:37,446 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportWithTargetName regions 2023-07-24 23:06:37,447 DEBUG [PEWorker-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 23:06:37,448 DEBUG [PEWorker-4] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf] 2023-07-24 23:06:37,453 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307244b8b76a3afd94338a24cc1e54ecc580d to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/c4ca4238a0b923820dcc509a6f75849b202307244b8b76a3afd94338a24cc1e54ecc580d 2023-07-24 23:06:37,455 DEBUG [PEWorker-4] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307244811bbfd2d99489f8764faec9c1289d6 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71/cf/d41d8cd98f00b204e9800998ecf8427e202307244811bbfd2d99489f8764faec9c1289d6 2023-07-24 23:06:37,456 DEBUG [PEWorker-4] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportWithTargetName/90c8eeaaf01a24f585da11044309be71 2023-07-24 23:06:37,459 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=26, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:37,488 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportWithTargetName from hbase:meta 2023-07-24 23:06:37,491 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportWithTargetName' descriptor. 2023-07-24 23:06:37,493 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=26, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:37,493 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportWithTargetName' from region states. 2023-07-24 23:06:37,493 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690239997493"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:37,493 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690239997493"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:37,496 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:06:37,496 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 433c6f439e02e0cd0d221cd7669daec0, NAME => 'testtb-testExportWithTargetName,,1690239979138.433c6f439e02e0cd0d221cd7669daec0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => c0c21dfe561bf83984edbd187c53a487, NAME => 'testtb-testExportWithTargetName,1,1690239979138.c0c21dfe561bf83984edbd187c53a487.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:06:37,496 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportWithTargetName' as deleted. 2023-07-24 23:06:37,496 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportWithTargetName","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690239997496"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:37,498 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportWithTargetName state from META 2023-07-24 23:06:37,501 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=26, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportWithTargetName 2023-07-24 23:06:37,503 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=26, state=SUCCESS; DeleteTableProcedure table=testtb-testExportWithTargetName in 91 msec 2023-07-24 23:06:37,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=26 2023-07-24 23:06:37,538 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportWithTargetName, procId: 26 completed 2023-07-24 23:06:37,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportWithTargetName" 2023-07-24 23:06:37,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportWithTargetName 2023-07-24 23:06:37,564 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportWithTargetName" 2023-07-24 23:06:37,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportWithTargetName 2023-07-24 23:06:37,599 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportWithTargetName Thread=751 (was 706) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_609255745_1 at /127.0.0.1:37752 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:46285 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:44924 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data4/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:33472 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: MutableQuantiles-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Container metrics unregistration java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: ContainersLauncher #0 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.read1(BufferedReader.java:212) java.io.BufferedReader.read(BufferedReader.java:286) org.apache.hadoop.util.Shell$ShellCommandExecutor.parseExecResult(Shell.java:1229) org.apache.hadoop.util.Shell.runCommand(Shell.java:984) org.apache.hadoop.util.Shell.run(Shell.java:884) org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1216) org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:294) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:442) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:293) org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:97) java.util.concurrent.FutureTask.run(FutureTask.java:266) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-1313 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: zk-permission-watcher-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data3/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ContainersLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:37780 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data6/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data5/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-6 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:38615 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: DeletionService #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DeletionService #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1081) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_609255745_1 at /127.0.0.1:44896 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=925 (was 900) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=417 (was 344) - SystemLoadAverage LEAK? -, ProcessCount=180 (was 175) - ProcessCount LEAK? -, AvailableMemoryMB=5895 (was 7711) 2023-07-24 23:06:37,599 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-24 23:06:37,626 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=751, OpenFileDescriptor=925, MaxFileDescriptor=60000, SystemLoadAverage=417, ProcessCount=180, AvailableMemoryMB=5893 2023-07-24 23:06:37,626 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=751 is superior to 500 2023-07-24 23:06:37,628 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 23:06:37,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:37,638 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:06:37,640 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemState" procId is: 27 2023-07-24 23:06:37,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 23:06:37,647 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:06:37,651 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:37,654 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459 empty. 2023-07-24 23:06:37,654 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:37,655 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:37,655 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65 empty. 2023-07-24 23:06:37,655 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:37,655 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 23:06:37,682 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:37,684 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6e9cbd0111d962a569f46843765dc459, NAME => 'testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:06:37,684 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => efe8e8a791d3fec6372c688138b4ab65, NAME => 'testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:06:37,719 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:37,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 6e9cbd0111d962a569f46843765dc459, disabling compactions & flushes 2023-07-24 23:06:37,726 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:37,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:37,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. after waiting 0 ms 2023-07-24 23:06:37,726 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:37,726 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:37,727 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 6e9cbd0111d962a569f46843765dc459: 2023-07-24 23:06:37,729 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:37,730 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing efe8e8a791d3fec6372c688138b4ab65, disabling compactions & flushes 2023-07-24 23:06:37,730 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:37,730 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:37,730 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. after waiting 0 ms 2023-07-24 23:06:37,730 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:37,730 INFO [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:37,730 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for efe8e8a791d3fec6372c688138b4ab65: 2023-07-24 23:06:37,733 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:06:37,735 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239997735"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239997735"}]},"ts":"1690239997735"} 2023-07-24 23:06:37,735 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239997735"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690239997735"}]},"ts":"1690239997735"} 2023-07-24 23:06:37,738 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:06:37,739 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:06:37,739 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239997739"}]},"ts":"1690239997739"} 2023-07-24 23:06:37,741 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 23:06:37,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 23:06:37,745 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:37,746 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:37,746 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:37,746 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:37,746 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:37,746 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e9cbd0111d962a569f46843765dc459, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=efe8e8a791d3fec6372c688138b4ab65, ASSIGN}] 2023-07-24 23:06:37,749 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e9cbd0111d962a569f46843765dc459, ASSIGN 2023-07-24 23:06:37,750 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=efe8e8a791d3fec6372c688138b4ab65, ASSIGN 2023-07-24 23:06:37,751 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e9cbd0111d962a569f46843765dc459, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39257,1690239969778; forceNewPlan=false, retain=false 2023-07-24 23:06:37,751 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=efe8e8a791d3fec6372c688138b4ab65, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42121,1690239969723; forceNewPlan=false, retain=false 2023-07-24 23:06:37,901 INFO [jenkins-hbase4:40271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:06:37,904 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6e9cbd0111d962a569f46843765dc459, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:37,904 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=efe8e8a791d3fec6372c688138b4ab65, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:37,904 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239997904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239997904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239997904"}]},"ts":"1690239997904"} 2023-07-24 23:06:37,904 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239997904"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690239997904"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690239997904"}]},"ts":"1690239997904"} 2023-07-24 23:06:37,906 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=30, ppid=28, state=RUNNABLE; OpenRegionProcedure 6e9cbd0111d962a569f46843765dc459, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:06:37,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=31, ppid=29, state=RUNNABLE; OpenRegionProcedure efe8e8a791d3fec6372c688138b4ab65, server=jenkins-hbase4.apache.org,42121,1690239969723}] 2023-07-24 23:06:37,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 23:06:38,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:38,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:38,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => efe8e8a791d3fec6372c688138b4ab65, NAME => 'testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:06:38,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6e9cbd0111d962a569f46843765dc459, NAME => 'testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:06:38,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. service=AccessControlService 2023-07-24 23:06:38,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:38,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. service=AccessControlService 2023-07-24 23:06:38,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:38,064 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:38,064 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:38,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:38,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:38,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemState 6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:38,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:38,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:38,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:38,067 INFO [StoreOpener-6e9cbd0111d962a569f46843765dc459-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:38,067 INFO [StoreOpener-efe8e8a791d3fec6372c688138b4ab65-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:38,068 DEBUG [StoreOpener-6e9cbd0111d962a569f46843765dc459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/cf 2023-07-24 23:06:38,068 DEBUG [StoreOpener-6e9cbd0111d962a569f46843765dc459-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/cf 2023-07-24 23:06:38,068 DEBUG [StoreOpener-efe8e8a791d3fec6372c688138b4ab65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/cf 2023-07-24 23:06:38,069 DEBUG [StoreOpener-efe8e8a791d3fec6372c688138b4ab65-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/cf 2023-07-24 23:06:38,069 INFO [StoreOpener-efe8e8a791d3fec6372c688138b4ab65-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region efe8e8a791d3fec6372c688138b4ab65 columnFamilyName cf 2023-07-24 23:06:38,069 INFO [StoreOpener-6e9cbd0111d962a569f46843765dc459-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6e9cbd0111d962a569f46843765dc459 columnFamilyName cf 2023-07-24 23:06:38,071 INFO [StoreOpener-6e9cbd0111d962a569f46843765dc459-1] regionserver.HStore(310): Store=6e9cbd0111d962a569f46843765dc459/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:38,071 INFO [StoreOpener-efe8e8a791d3fec6372c688138b4ab65-1] regionserver.HStore(310): Store=efe8e8a791d3fec6372c688138b4ab65/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:38,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:38,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:38,075 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:38,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:38,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:38,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:38,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:38,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:38,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6e9cbd0111d962a569f46843765dc459; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67738876, jitterRate=0.00938791036605835}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:38,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6e9cbd0111d962a569f46843765dc459: 2023-07-24 23:06:38,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened efe8e8a791d3fec6372c688138b4ab65; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74379938, jitterRate=0.10834744572639465}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:38,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for efe8e8a791d3fec6372c688138b4ab65: 2023-07-24 23:06:38,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65., pid=31, masterSystemTime=1690239998059 2023-07-24 23:06:38,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:38,097 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:38,098 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=efe8e8a791d3fec6372c688138b4ab65, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,098 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239998098"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239998098"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239998098"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239998098"}]},"ts":"1690239998098"} 2023-07-24 23:06:38,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459., pid=30, masterSystemTime=1690239998059 2023-07-24 23:06:38,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:38,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:38,102 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=6e9cbd0111d962a569f46843765dc459, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,106 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690239998102"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690239998102"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690239998102"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690239998102"}]},"ts":"1690239998102"} 2023-07-24 23:06:38,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=31, resume processing ppid=29 2023-07-24 23:06:38,107 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=31, ppid=29, state=SUCCESS; OpenRegionProcedure efe8e8a791d3fec6372c688138b4ab65, server=jenkins-hbase4.apache.org,42121,1690239969723 in 194 msec 2023-07-24 23:06:38,109 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=efe8e8a791d3fec6372c688138b4ab65, ASSIGN in 361 msec 2023-07-24 23:06:38,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=30, resume processing ppid=28 2023-07-24 23:06:38,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=30, ppid=28, state=SUCCESS; OpenRegionProcedure 6e9cbd0111d962a569f46843765dc459, server=jenkins-hbase4.apache.org,39257,1690239969778 in 202 msec 2023-07-24 23:06:38,121 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=28, resume processing ppid=27 2023-07-24 23:06:38,122 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e9cbd0111d962a569f46843765dc459, ASSIGN in 366 msec 2023-07-24 23:06:38,123 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:06:38,123 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690239998123"}]},"ts":"1690239998123"} 2023-07-24 23:06:38,125 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 23:06:38,127 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:06:38,128 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemState jenkins: RWXCA 2023-07-24 23:06:38,130 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:06:38,131 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:38,131 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:38,131 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:38,131 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:38,134 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:38,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:38,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:38,135 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF\x0AF\x0A\x07jenkins\x12;\x08\x03"7\x0A+\x0A\x07default\x12 testtb-testExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:38,137 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemState in 505 msec 2023-07-24 23:06:38,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-07-24 23:06:38,247 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemState, procId: 27 completed 2023-07-24 23:06:38,250 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 23:06:38,250 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:38,252 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:38,268 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:38,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690239998268 (current time:1690239998268). 2023-07-24 23:06:38,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:38,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x72dcb19d to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:38,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7716c8a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:38,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:38,282 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:38,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x72dcb19d to 127.0.0.1:58202 2023-07-24 23:06:38,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:38,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x51641dee to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:38,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46a30e06, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:38,291 DEBUG [hconnection-0x4a3a2f64-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:38,294 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55528, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:38,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:38,299 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:38,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x51641dee to 127.0.0.1:58202 2023-07-24 23:06:38,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:38,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:06:38,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:38,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:38,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:38,306 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=32, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:38,307 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=32, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690240598307 2023-07-24 23:06:38,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:38,307 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 23:06:38,309 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:38,309 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:38,313 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=32, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:38,313 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:38,319 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=32, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-24 23:06:38,320 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=33, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:38,326 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=33, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690240598325 2023-07-24 23:06:38,405 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,405 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemState' 2023-07-24 23:06:38,405 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:38,408 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 23:06:38,408 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 23:06:38,408 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,409 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,409 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:38,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:06:38,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:38,410 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,410 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,410 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,410 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:38,410 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,410 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,411 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,410 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,411 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,411 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,411 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,412 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,412 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:38,412 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 23:06:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 23:06:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 174 2023-07-24 23:06:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:38,413 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:38,412 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:38,415 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:38,415 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:38,416 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,416 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:38,416 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:38,417 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,417 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:38,421 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:38,421 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:38,421 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:38,421 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:38,421 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:38,421 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:38,421 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:38,424 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:38,425 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:38,425 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:38,428 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,428 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:38,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:38,434 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,434 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,434 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,434 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,434 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:38,435 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,435 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:38,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:38,435 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,435 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:38,435 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:38,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,436 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,437 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:38,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 23:06:38,439 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a757dbf[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:38,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:38,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:38,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:38,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemState' on coordinator 2023-07-24 23:06:38,443 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7a757dbf[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:38,443 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 23:06:38,443 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,445 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,445 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,445 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,445 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,445 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:38,445 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:38,445 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,445 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:38,445 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:38,445 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:06:38,445 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,446 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,446 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:38,446 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:38,446 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:38,447 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:38,447 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:38,447 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:38,447 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. started... 2023-07-24 23:06:38,447 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:38,447 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. started... 2023-07-24 23:06:38,447 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e9cbd0111d962a569f46843765dc459: 2023-07-24 23:06:38,447 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:38,449 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:38,449 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:38,449 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,449 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for efe8e8a791d3fec6372c688138b4ab65: 2023-07-24 23:06:38,451 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:38,451 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:38,451 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,452 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:38,452 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:38,479 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. completed. 2023-07-24 23:06:38,484 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:38,484 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:06:38,486 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,487 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:38,487 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:38,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:38,487 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:38,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:38,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:38,490 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. completed. 2023-07-24 23:06:38,490 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,490 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:06:38,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,491 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:38,491 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,491 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:38,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,492 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:38,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:38,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42121,1690239969723': 2023-07-24 23:06:38,495 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 23:06:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:38,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:38,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:06:38,499 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'emptySnaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 23:06:38,499 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemState' execution completed 2023-07-24 23:06:38,499 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:38,499 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:38,499 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,499 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:38,501 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,501 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:38,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,502 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:38,502 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,502 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,503 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:38,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,505 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:38,505 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,505 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,506 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,506 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,510 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,510 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,510 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,510 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,510 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:38,510 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,510 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,511 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:38,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,510 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:38,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,510 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,511 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,512 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 23:06:38,511 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:38,511 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:38,510 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,513 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,513 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:38,513 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:06:38,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:38,513 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:38,513 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,513 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:38,513 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:38,513 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,513 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,514 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 23:06:38,611 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:38,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:06:38,612 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:38,612 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:06:38,912 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:38,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:06:38,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:38,914 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 23:06:38,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,974 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:38,999 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 23:06:38,999 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:39,000 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:39,000 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690239998307Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690239998932 (+625 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemState at 1690239998932Loading Region manifests for emptySnaptb0-testExportFileSystemState at 1690239998932Writing data manifest for emptySnaptb0-testExportFileSystemState at 1690239998939 (+7 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemState at 1690239998966 (+27 ms)Snapshot emptySnaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690239998999 (+33 ms) 2023-07-24 23:06:39,002 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=33, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:39,005 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=33, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 695 msec 2023-07-24 23:06:39,414 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:39,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:06:39,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:39,420 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39257] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:39,422 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42121] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:39,427 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemState 2023-07-24 23:06:39,427 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:39,427 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:39,448 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:39,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690239999448 (current time:1690239999448). 2023-07-24 23:06:39,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:39,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x06c24c57 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:39,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4cc74f58, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:39,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:39,462 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:39,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x06c24c57 to 127.0.0.1:58202 2023-07-24 23:06:39,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:39,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x7d51c0ac to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:39,478 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1faea44e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:39,480 DEBUG [hconnection-0x7e1d1403-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:39,481 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55538, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:39,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:39,490 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49420, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:39,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7d51c0ac to 127.0.0.1:58202 2023-07-24 23:06:39,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:39,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:06:39,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:39,492 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:39,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:39,496 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:39,497 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690240599497 2023-07-24 23:06:39,497 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState 2023-07-24 23:06:39,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:06:39,498 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:39,498 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:39,499 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:39,499 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:06:39,505 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=EXCLUSIVE in 6 msec 2023-07-24 23:06:39,506 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=35, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:39,516 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=35, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690240599516 2023-07-24 23:06:39,549 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemState 2023-07-24 23:06:39,549 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemState' 2023-07-24 23:06:39,549 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:39,551 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemState' starting 'acquire' 2023-07-24 23:06:39,551 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemState', kicking off acquire phase on members. 2023-07-24 23:06:39,551 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,552 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,553 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:39,553 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:39,553 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:39,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:39,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:39,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:39,553 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:39,553 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:39,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:39,553 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,554 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,554 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,554 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:39,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,554 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 23:06:39,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 23:06:39,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:39,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 169 2023-07-24 23:06:39,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:39,555 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 23:06:39,555 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemState from table testtb-testExportFileSystemState type FLUSH 2023-07-24 23:06:39,555 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:39,555 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:39,560 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:39,560 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:39,560 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 23:06:39,560 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:39,560 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:39,560 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:39,561 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:39,561 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:39,561 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:39,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemState 2023-07-24 23:06:39,563 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemState' with timeout 300000ms 2023-07-24 23:06:39,563 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:39,564 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemState' starting 'acquire' stage 2023-07-24 23:06:39,564 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemState' locally acquired 2023-07-24 23:06:39,564 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (snaptb0-testExportFileSystemState) in zk 2023-07-24 23:06:39,567 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,567 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:39,567 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:39,567 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:39,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:39,569 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,569 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:39,569 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,570 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,571 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:39,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 23:06:39,571 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c88bc04[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:39,572 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,573 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,574 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:39,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'snaptb0-testExportFileSystemState' on coordinator 2023-07-24 23:06:39,574 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c88bc04[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:39,574 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 23:06:39,574 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,576 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,576 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,576 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,576 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:39,576 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:39,576 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:06:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:06:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:39,576 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,576 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:39,577 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:39,576 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:39,576 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:39,577 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:39,577 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. started... 2023-07-24 23:06:39,577 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. started... 2023-07-24 23:06:39,577 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 6e9cbd0111d962a569f46843765dc459 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 23:06:39,577 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2745): Flushing efe8e8a791d3fec6372c688138b4ab65 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 23:06:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:39,578 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:39,599 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:39,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:06:39,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:39,601 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:39,607 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023072489fb389a5c134a278b3a7b97fd81e055 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072489fb389a5c134a278b3a7b97fd81e055 2023-07-24 23:06:39,608 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072483cedf11106c47419bc85114bfe35963 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072483cedf11106c47419bc85114bfe35963 2023-07-24 23:06:39,633 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/.tmp/cf/4e13a16bf00f4558bb01e354a34c621b 2023-07-24 23:06:39,634 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/.tmp/cf/1d8c3cf2cba74528a1acf282c553732e 2023-07-24 23:06:39,641 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/.tmp/cf/1d8c3cf2cba74528a1acf282c553732e as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/cf/1d8c3cf2cba74528a1acf282c553732e 2023-07-24 23:06:39,642 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/.tmp/cf/4e13a16bf00f4558bb01e354a34c621b as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/cf/4e13a16bf00f4558bb01e354a34c621b 2023-07-24 23:06:39,649 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/cf/1d8c3cf2cba74528a1acf282c553732e, entries=48, sequenceid=6, filesize=13.0 K 2023-07-24 23:06:39,650 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/cf/4e13a16bf00f4558bb01e354a34c621b, entries=2, sequenceid=6, filesize=5.2 K 2023-07-24 23:06:39,650 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for efe8e8a791d3fec6372c688138b4ab65 in 73ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:39,651 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemState' 2023-07-24 23:06:39,651 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for efe8e8a791d3fec6372c688138b4ab65: 2023-07-24 23:06:39,651 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 23:06:39,651 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 6e9cbd0111d962a569f46843765dc459 in 74ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:39,651 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:39,653 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 6e9cbd0111d962a569f46843765dc459: 2023-07-24 23:06:39,653 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/cf/1d8c3cf2cba74528a1acf282c553732e] hfiles 2023-07-24 23:06:39,653 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/cf/1d8c3cf2cba74528a1acf282c553732e for snapshot=snaptb0-testExportFileSystemState 2023-07-24 23:06:39,653 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 23:06:39,653 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:39,653 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/cf/4e13a16bf00f4558bb01e354a34c621b] hfiles 2023-07-24 23:06:39,653 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/cf/4e13a16bf00f4558bb01e354a34c621b for snapshot=snaptb0-testExportFileSystemState 2023-07-24 23:06:39,670 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. completed. 2023-07-24 23:06:39,670 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:39,670 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:39,670 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:39,670 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,670 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:39,670 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:06:39,673 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. completed. 2023-07-24 23:06:39,673 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:39,673 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:39,673 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:39,673 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,673 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemState' locally completed 2023-07-24 23:06:39,673 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:06:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:39,676 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,676 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:39,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:39,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:39,679 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemState' has notified controller of completion 2023-07-24 23:06:39,679 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:39,679 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:39,679 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemState' completed. 2023-07-24 23:06:39,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:39,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:39,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:39,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:39,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:06:39,683 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 23:06:39,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:39,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:39,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemState' member 'jenkins-hbase4.apache.org,42121,1690239969723': 2023-07-24 23:06:39,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' released barrier for procedure'snaptb0-testExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 23:06:39,687 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemState' execution completed 2023-07-24 23:06:39,687 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:39,687 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:39,687 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemState 2023-07-24 23:06:39,687 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:39,689 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,689 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,689 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:39,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:39,689 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,689 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:39,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,689 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:39,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:39,689 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:39,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:39,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:39,690 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:39,690 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:39,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:39,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:39,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:39,690 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,691 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:39,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemState 2023-07-24 23:06:39,693 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,693 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,694 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,697 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,697 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:39,697 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:39,697 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:39,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:39,697 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:39,697 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,697 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,698 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,698 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,698 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:39,698 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemState 2023-07-24 23:06:39,698 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemState 2023-07-24 23:06:39,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:39,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 8c2558c0b59bb3a4e2e578c2c8e8915d, NAME => 'testtb-testExportFileSystemState,.mob,0.8c2558c0b59bb3a4e2e578c2c8e8915d.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemState 2023-07-24 23:06:39,697 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:39,698 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:06:39,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:39,698 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:39,698 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:39,698 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,698 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,698 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:39,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:39,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:39,697 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:39,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:39,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:39,698 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:39,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:39,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:39,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072483cedf11106c47419bc85114bfe35963, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072489fb389a5c134a278b3a7b97fd81e055] mob files 2023-07-24 23:06:39,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:39,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:39,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072483cedf11106c47419bc85114bfe35963 2023-07-24 23:06:39,701 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072489fb389a5c134a278b3a7b97fd81e055 2023-07-24 23:06:39,712 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemState 2023-07-24 23:06:39,713 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,735 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,764 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed 2023-07-24 23:06:39,764 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,764 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemState at 1690239999497Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemState at 1690239999712 (+215 ms)Consolidate snapshot: snaptb0-testExportFileSystemState at 1690239999712Loading Region manifests for snaptb0-testExportFileSystemState at 1690239999712Writing data manifest for snaptb0-testExportFileSystemState at 1690239999716 (+4 ms)Verifying snapshot: snaptb0-testExportFileSystemState at 1690239999727 (+11 ms)Snapshot snaptb0-testExportFileSystemState of table testtb-testExportFileSystemState completed at 1690239999764 (+37 ms) 2023-07-24 23:06:39,767 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=35, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED 2023-07-24 23:06:39,769 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=35, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemState, type=SHARED in 269 msec 2023-07-24 23:06:39,801 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:39,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:06:39,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemState table=testtb-testExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:39,802 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239999802 2023-07-24 23:06:39,802 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33513, tgtDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239999802, rawTgtDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239999802, srcFsUri=hdfs://localhost:33513, srcDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:06:39,826 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:06:39,827 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_888370606_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239999802, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239999802/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,827 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316, snapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemState. 2023-07-24 23:06:39,837 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemState to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239999802/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemState 2023-07-24 23:06:39,860 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,860 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,861 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,861 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,862 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,862 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,863 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,938 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop-2384766465860093701.jar 2023-07-24 23:06:39,939 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,939 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,940 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,940 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,941 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,941 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:39,941 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:06:39,942 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:06:39,942 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:06:39,943 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:06:39,943 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:06:39,943 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:06:39,944 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:06:39,944 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:06:39,944 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:06:39,945 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:06:39,945 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:39,946 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:39,946 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:39,947 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:39,947 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:39,947 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:39,948 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:40,790 WARN [Listener at jenkins-hbase4.apache.org/36985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:06:40,793 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemState' hfile list 2023-07-24 23:06:40,795 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(671): export split=0 size=30.9 K 2023-07-24 23:06:41,881 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:41,882 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:41,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0001_000001 (auth:SIMPLE) 2023-07-24 23:06:42,041 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0002_000001 (auth:SIMPLE) 2023-07-24 23:06:42,899 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:06:47,012 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0002_000001 (auth:SIMPLE) 2023-07-24 23:06:49,247 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0002_000001 (auth:SIMPLE) 2023-07-24 23:06:52,841 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0002_000001 (auth:SIMPLE) 2023-07-24 23:06:54,006 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:06:54,008 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:06:54,017 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemState 2023-07-24 23:06:54,018 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:06:54,018 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:06:54,018 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 23:06:54,019 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 23:06:54,019 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 23:06:54,019 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239999802/.hbase-snapshot/snaptb0-testExportFileSystemState at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239999802/.hbase-snapshot/snaptb0-testExportFileSystemState 2023-07-24 23:06:54,020 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239999802/.hbase-snapshot/snaptb0-testExportFileSystemState/.snapshotinfo 2023-07-24 23:06:54,020 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690239999802/.hbase-snapshot/snaptb0-testExportFileSystemState/data.manifest 2023-07-24 23:06:54,029 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemState 2023-07-24 23:06:54,030 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemState 2023-07-24 23:06:54,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=36, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:54,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 23:06:54,036 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240014036"}]},"ts":"1690240014036"} 2023-07-24 23:06:54,038 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 23:06:54,044 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemState to state=DISABLING 2023-07-24 23:06:54,045 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e9cbd0111d962a569f46843765dc459, UNASSIGN}, {pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=efe8e8a791d3fec6372c688138b4ab65, UNASSIGN}] 2023-07-24 23:06:54,048 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=37, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e9cbd0111d962a569f46843765dc459, UNASSIGN 2023-07-24 23:06:54,049 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=38, ppid=36, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=efe8e8a791d3fec6372c688138b4ab65, UNASSIGN 2023-07-24 23:06:54,049 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6e9cbd0111d962a569f46843765dc459, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:54,050 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690240014049"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240014049"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240014049"}]},"ts":"1690240014049"} 2023-07-24 23:06:54,050 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=efe8e8a791d3fec6372c688138b4ab65, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:54,050 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690240014050"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240014050"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240014050"}]},"ts":"1690240014050"} 2023-07-24 23:06:54,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=39, ppid=37, state=RUNNABLE; CloseRegionProcedure 6e9cbd0111d962a569f46843765dc459, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:06:54,053 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=40, ppid=38, state=RUNNABLE; CloseRegionProcedure efe8e8a791d3fec6372c688138b4ab65, server=jenkins-hbase4.apache.org,42121,1690239969723}] 2023-07-24 23:06:54,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 23:06:54,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:54,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6e9cbd0111d962a569f46843765dc459, disabling compactions & flushes 2023-07-24 23:06:54,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:54,205 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:54,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. after waiting 0 ms 2023-07-24 23:06:54,206 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:54,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:54,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing efe8e8a791d3fec6372c688138b4ab65, disabling compactions & flushes 2023-07-24 23:06:54,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:54,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:54,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. after waiting 0 ms 2023-07-24 23:06:54,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:54,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:06:54,221 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:54,222 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459. 2023-07-24 23:06:54,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6e9cbd0111d962a569f46843765dc459: 2023-07-24 23:06:54,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:06:54,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:54,224 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:06:54,225 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=37 updating hbase:meta row=6e9cbd0111d962a569f46843765dc459, regionState=CLOSED 2023-07-24 23:06:54,225 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690240014225"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240014225"}]},"ts":"1690240014225"} 2023-07-24 23:06:54,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65. 2023-07-24 23:06:54,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for efe8e8a791d3fec6372c688138b4ab65: 2023-07-24 23:06:54,227 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:54,228 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=38 updating hbase:meta row=efe8e8a791d3fec6372c688138b4ab65, regionState=CLOSED 2023-07-24 23:06:54,228 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.","families":{"info":[{"qualifier":"regioninfo","vlen":67,"tag":[],"timestamp":"1690240014228"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240014228"}]},"ts":"1690240014228"} 2023-07-24 23:06:54,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=39, resume processing ppid=37 2023-07-24 23:06:54,231 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=39, ppid=37, state=SUCCESS; CloseRegionProcedure 6e9cbd0111d962a569f46843765dc459, server=jenkins-hbase4.apache.org,39257,1690239969778 in 175 msec 2023-07-24 23:06:54,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=37, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=6e9cbd0111d962a569f46843765dc459, UNASSIGN in 187 msec 2023-07-24 23:06:54,234 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=40, resume processing ppid=38 2023-07-24 23:06:54,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=40, ppid=38, state=SUCCESS; CloseRegionProcedure efe8e8a791d3fec6372c688138b4ab65, server=jenkins-hbase4.apache.org,42121,1690239969723 in 178 msec 2023-07-24 23:06:54,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=38, resume processing ppid=36 2023-07-24 23:06:54,241 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=38, ppid=36, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemState, region=efe8e8a791d3fec6372c688138b4ab65, UNASSIGN in 190 msec 2023-07-24 23:06:54,243 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240014243"}]},"ts":"1690240014243"} 2023-07-24 23:06:54,246 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 23:06:54,248 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemState to state=DISABLED 2023-07-24 23:06:54,250 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=36, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemState in 219 msec 2023-07-24 23:06:54,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=36 2023-07-24 23:06:54,339 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemState, procId: 36 completed 2023-07-24 23:06:54,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemState 2023-07-24 23:06:54,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:54,344 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=41, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:54,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemState 2023-07-24 23:06:54,345 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=41, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:54,346 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemState 2023-07-24 23:06:54,350 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:54,350 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:54,350 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:54,350 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:54,351 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:54,351 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 23:06:54,351 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:54,351 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 23:06:54,351 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data PBUF 2023-07-24 23:06:54,352 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:54,352 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:54,352 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemState with data null 2023-07-24 23:06:54,352 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemState 2023-07-24 23:06:54,352 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:54,352 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:06:54,352 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:54,352 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:54,352 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:54,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 23:06:54,354 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/recovered.edits] 2023-07-24 23:06:54,354 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/recovered.edits] 2023-07-24 23:06:54,359 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/cf/4e13a16bf00f4558bb01e354a34c621b to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/cf/4e13a16bf00f4558bb01e354a34c621b 2023-07-24 23:06:54,360 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/cf/1d8c3cf2cba74528a1acf282c553732e to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/cf/1d8c3cf2cba74528a1acf282c553732e 2023-07-24 23:06:54,364 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459/recovered.edits/9.seqid 2023-07-24 23:06:54,364 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65/recovered.edits/9.seqid 2023-07-24 23:06:54,364 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/6e9cbd0111d962a569f46843765dc459 2023-07-24 23:06:54,365 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemState/efe8e8a791d3fec6372c688138b4ab65 2023-07-24 23:06:54,365 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemState regions 2023-07-24 23:06:54,365 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 23:06:54,366 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf] 2023-07-24 23:06:54,370 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072483cedf11106c47419bc85114bfe35963 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/c4ca4238a0b923820dcc509a6f75849b2023072483cedf11106c47419bc85114bfe35963 2023-07-24 23:06:54,372 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072489fb389a5c134a278b3a7b97fd81e055 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d/cf/d41d8cd98f00b204e9800998ecf8427e2023072489fb389a5c134a278b3a7b97fd81e055 2023-07-24 23:06:54,372 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemState/8c2558c0b59bb3a4e2e578c2c8e8915d 2023-07-24 23:06:54,378 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=41, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:54,385 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemState from hbase:meta 2023-07-24 23:06:54,389 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemState' descriptor. 2023-07-24 23:06:54,391 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=41, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:54,391 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemState' from region states. 2023-07-24 23:06:54,391 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240014391"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:54,391 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240014391"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:54,406 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:06:54,406 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6e9cbd0111d962a569f46843765dc459, NAME => 'testtb-testExportFileSystemState,,1690239997628.6e9cbd0111d962a569f46843765dc459.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => efe8e8a791d3fec6372c688138b4ab65, NAME => 'testtb-testExportFileSystemState,1,1690239997628.efe8e8a791d3fec6372c688138b4ab65.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:06:54,406 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemState' as deleted. 2023-07-24 23:06:54,406 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240014406"}]},"ts":"9223372036854775807"} 2023-07-24 23:06:54,410 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemState state from META 2023-07-24 23:06:54,414 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=41, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemState 2023-07-24 23:06:54,418 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=41, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemState in 74 msec 2023-07-24 23:06:54,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=41 2023-07-24 23:06:54,455 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemState, procId: 41 completed 2023-07-24 23:06:54,465 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemState" 2023-07-24 23:06:54,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemState 2023-07-24 23:06:54,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemState" 2023-07-24 23:06:54,471 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemState 2023-07-24 23:06:54,505 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemState Thread=759 (was 751) Potentially hanging thread: HFileArchiver-8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:54414 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_431289858_1 at /127.0.0.1:60706 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:60724 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:44935 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:40987 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: HFileArchiver-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Thread-2027 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: LogDeleter #0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1093) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:36810 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_431289858_1 at /127.0.0.1:54388 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=937 (was 925) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=380 (was 417), ProcessCount=180 (was 180), AvailableMemoryMB=5714 (was 5893) 2023-07-24 23:06:54,505 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-24 23:06:54,531 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=759, OpenFileDescriptor=937, MaxFileDescriptor=60000, SystemLoadAverage=380, ProcessCount=180, AvailableMemoryMB=5713 2023-07-24 23:06:54,531 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=759 is superior to 500 2023-07-24 23:06:54,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 23:06:54,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:06:54,537 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:06:54,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testConsecutiveExports" procId is: 42 2023-07-24 23:06:54,538 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:06:54,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 23:06:54,541 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:06:54,543 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5 empty. 2023-07-24 23:06:54,543 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:06:54,543 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:06:54,543 DEBUG [HFileArchiver-12] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac empty. 2023-07-24 23:06:54,544 DEBUG [HFileArchiver-12] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:06:54,544 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 23:06:54,569 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/.tabledesc/.tableinfo.0000000001 2023-07-24 23:06:54,571 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(7675): creating {ENCODED => 813638e7966319ffcf7afe9843d3ddb5, NAME => 'testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:06:54,571 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(7675): creating {ENCODED => ad36a0a8bdfd67e5e530c6ee5d2423ac, NAME => 'testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testConsecutiveExports', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:06:54,616 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:54,616 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1604): Closing 813638e7966319ffcf7afe9843d3ddb5, disabling compactions & flushes 2023-07-24 23:06:54,616 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:54,616 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:54,616 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. after waiting 0 ms 2023-07-24 23:06:54,616 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:54,616 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:54,617 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-0] regionserver.HRegion(1558): Region close journal for 813638e7966319ffcf7afe9843d3ddb5: 2023-07-24 23:06:54,619 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:54,620 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1604): Closing ad36a0a8bdfd67e5e530c6ee5d2423ac, disabling compactions & flushes 2023-07-24 23:06:54,620 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:54,620 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:54,620 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. after waiting 0 ms 2023-07-24 23:06:54,620 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:54,620 INFO [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:54,620 DEBUG [RegionOpenAndInit-testtb-testConsecutiveExports-pool-1] regionserver.HRegion(1558): Region close journal for ad36a0a8bdfd67e5e530c6ee5d2423ac: 2023-07-24 23:06:54,623 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:06:54,624 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240014624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240014624"}]},"ts":"1690240014624"} 2023-07-24 23:06:54,624 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240014624"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240014624"}]},"ts":"1690240014624"} 2023-07-24 23:06:54,627 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:06:54,628 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:06:54,629 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240014629"}]},"ts":"1690240014629"} 2023-07-24 23:06:54,630 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLING in hbase:meta 2023-07-24 23:06:54,634 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:06:54,636 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:06:54,636 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:06:54,636 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:06:54,636 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:06:54,636 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=813638e7966319ffcf7afe9843d3ddb5, ASSIGN}, {pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad36a0a8bdfd67e5e530c6ee5d2423ac, ASSIGN}] 2023-07-24 23:06:54,639 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad36a0a8bdfd67e5e530c6ee5d2423ac, ASSIGN 2023-07-24 23:06:54,640 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=813638e7966319ffcf7afe9843d3ddb5, ASSIGN 2023-07-24 23:06:54,643 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=44, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad36a0a8bdfd67e5e530c6ee5d2423ac, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39257,1690239969778; forceNewPlan=false, retain=false 2023-07-24 23:06:54,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 23:06:54,643 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=43, ppid=42, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=813638e7966319ffcf7afe9843d3ddb5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34249,1690239969818; forceNewPlan=false, retain=false 2023-07-24 23:06:54,793 INFO [jenkins-hbase4:40271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:06:54,795 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ad36a0a8bdfd67e5e530c6ee5d2423ac, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:54,795 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=813638e7966319ffcf7afe9843d3ddb5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:54,796 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240014795"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240014795"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240014795"}]},"ts":"1690240014795"} 2023-07-24 23:06:54,796 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240014795"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240014795"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240014795"}]},"ts":"1690240014795"} 2023-07-24 23:06:54,798 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE; OpenRegionProcedure ad36a0a8bdfd67e5e530c6ee5d2423ac, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:06:54,799 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=46, ppid=43, state=RUNNABLE; OpenRegionProcedure 813638e7966319ffcf7afe9843d3ddb5, server=jenkins-hbase4.apache.org,34249,1690239969818}] 2023-07-24 23:06:54,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 23:06:54,959 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:54,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ad36a0a8bdfd67e5e530c6ee5d2423ac, NAME => 'testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:06:54,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. service=AccessControlService 2023-07-24 23:06:54,960 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:54,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:06:54,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:54,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:06:54,960 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:06:54,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:54,962 INFO [StoreOpener-ad36a0a8bdfd67e5e530c6ee5d2423ac-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:06:54,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 813638e7966319ffcf7afe9843d3ddb5, NAME => 'testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:06:54,962 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. service=AccessControlService 2023-07-24 23:06:54,963 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:06:54,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testConsecutiveExports 813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:06:54,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:06:54,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:06:54,963 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:06:54,966 INFO [StoreOpener-813638e7966319ffcf7afe9843d3ddb5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:06:54,966 DEBUG [StoreOpener-ad36a0a8bdfd67e5e530c6ee5d2423ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/cf 2023-07-24 23:06:54,966 DEBUG [StoreOpener-ad36a0a8bdfd67e5e530c6ee5d2423ac-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/cf 2023-07-24 23:06:54,966 INFO [StoreOpener-ad36a0a8bdfd67e5e530c6ee5d2423ac-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ad36a0a8bdfd67e5e530c6ee5d2423ac columnFamilyName cf 2023-07-24 23:06:54,967 DEBUG [StoreOpener-813638e7966319ffcf7afe9843d3ddb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/cf 2023-07-24 23:06:54,967 DEBUG [StoreOpener-813638e7966319ffcf7afe9843d3ddb5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/cf 2023-07-24 23:06:54,968 INFO [StoreOpener-813638e7966319ffcf7afe9843d3ddb5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 813638e7966319ffcf7afe9843d3ddb5 columnFamilyName cf 2023-07-24 23:06:54,968 INFO [StoreOpener-ad36a0a8bdfd67e5e530c6ee5d2423ac-1] regionserver.HStore(310): Store=ad36a0a8bdfd67e5e530c6ee5d2423ac/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:54,969 INFO [StoreOpener-813638e7966319ffcf7afe9843d3ddb5-1] regionserver.HStore(310): Store=813638e7966319ffcf7afe9843d3ddb5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:06:54,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:06:54,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:06:54,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:06:54,971 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:06:54,973 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:06:54,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:06:54,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:54,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:06:54,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ad36a0a8bdfd67e5e530c6ee5d2423ac; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70530485, jitterRate=0.05098612606525421}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:54,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ad36a0a8bdfd67e5e530c6ee5d2423ac: 2023-07-24 23:06:54,976 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 813638e7966319ffcf7afe9843d3ddb5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63765895, jitterRate=-0.049814119935035706}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:06:54,976 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 813638e7966319ffcf7afe9843d3ddb5: 2023-07-24 23:06:54,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac., pid=45, masterSystemTime=1690240014950 2023-07-24 23:06:54,977 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5., pid=46, masterSystemTime=1690240014951 2023-07-24 23:06:54,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:54,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:54,981 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=44 updating hbase:meta row=ad36a0a8bdfd67e5e530c6ee5d2423ac, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:54,981 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240014981"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240014981"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240014981"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240014981"}]},"ts":"1690240014981"} 2023-07-24 23:06:54,983 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:54,983 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:54,984 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=43 updating hbase:meta row=813638e7966319ffcf7afe9843d3ddb5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:54,984 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240014983"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240014983"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240014983"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240014983"}]},"ts":"1690240014983"} 2023-07-24 23:06:54,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=45, resume processing ppid=44 2023-07-24 23:06:54,986 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=45, ppid=44, state=SUCCESS; OpenRegionProcedure ad36a0a8bdfd67e5e530c6ee5d2423ac, server=jenkins-hbase4.apache.org,39257,1690239969778 in 185 msec 2023-07-24 23:06:54,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=46, resume processing ppid=43 2023-07-24 23:06:54,988 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=44, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad36a0a8bdfd67e5e530c6ee5d2423ac, ASSIGN in 350 msec 2023-07-24 23:06:54,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=46, ppid=43, state=SUCCESS; OpenRegionProcedure 813638e7966319ffcf7afe9843d3ddb5, server=jenkins-hbase4.apache.org,34249,1690239969818 in 186 msec 2023-07-24 23:06:54,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=43, resume processing ppid=42 2023-07-24 23:06:54,991 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=43, ppid=42, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=813638e7966319ffcf7afe9843d3ddb5, ASSIGN in 352 msec 2023-07-24 23:06:54,992 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:06:54,992 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240014992"}]},"ts":"1690240014992"} 2023-07-24 23:06:54,995 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=ENABLED in hbase:meta 2023-07-24 23:06:54,998 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=42, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testConsecutiveExports execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:06:54,998 DEBUG [PEWorker-5] access.PermissionStorage(175): Writing permission with rowKey testtb-testConsecutiveExports jenkins: RWXCA 2023-07-24 23:06:55,000 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 23:06:55,002 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:55,002 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:55,002 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:55,002 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:06:55,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:55,003 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:55,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:55,004 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF\x0AC\x0A\x07jenkins\x128\x08\x03"4\x0A(\x0A\x07default\x12\x1Dtesttb-testConsecutiveExports \x00 \x01 \x02 \x03 \x04 2023-07-24 23:06:55,005 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=42, state=SUCCESS; CreateTableProcedure table=testtb-testConsecutiveExports in 471 msec 2023-07-24 23:06:55,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=42 2023-07-24 23:06:55,145 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testConsecutiveExports, procId: 42 completed 2023-07-24 23:06:55,148 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 23:06:55,148 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:55,151 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:55,160 DEBUG [hconnection-0x15927c21-shared-pool-16] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:55,169 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37520, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:55,180 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240015181 (current time:1690240015181). 2023-07-24 23:06:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:55,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x0a0ae285 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:55,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45294803, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:55,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:55,198 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36526, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:55,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a0ae285 to 127.0.0.1:58202 2023-07-24 23:06:55,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:55,200 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x49ed2d32 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:55,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@142ef040, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:55,219 DEBUG [hconnection-0x1b48db96-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:55,223 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36540, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:55,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:55,231 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37534, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:55,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x49ed2d32 to 127.0.0.1:58202 2023-07-24 23:06:55,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:55,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 23:06:55,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:55,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:55,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:55,241 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=47, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:55,242 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=47, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690240615242 2023-07-24 23:06:55,242 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 23:06:55,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:55,244 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:55,244 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:55,245 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:55,247 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=47, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:55,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=47, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 12 msec 2023-07-24 23:06:55,250 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:55,251 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690240615251 2023-07-24 23:06:55,285 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,285 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testConsecutiveExports' 2023-07-24 23:06:55,286 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:55,287 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 23:06:55,288 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 23:06:55,288 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,288 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,294 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,294 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,294 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,294 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,295 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,295 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,295 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,295 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,296 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:55,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,296 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 23:06:55,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,297 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:55,298 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,299 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:55,299 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:55,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,301 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:55,301 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:55,301 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:55,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,301 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,304 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:55,304 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 23:06:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,304 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 165 2023-07-24 23:06:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:55,306 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:55,306 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:55,306 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,306 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:55,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:55,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 23:06:55,308 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f82204[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:55,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,310 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,310 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:55,310 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:55,310 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:55,310 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:55,312 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:55,315 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:55,315 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:55,315 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:55,315 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:55,315 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (emptySnaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:55,317 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,317 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,317 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:55,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:55,317 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,317 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:55,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:55,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:55,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:55,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure 'emptySnaptb0-testConsecutiveExports' on coordinator 2023-07-24 23:06:55,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7f82204[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:55,320 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 23:06:55,320 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,321 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,321 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,321 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:55,321 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:06:55,321 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,322 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:55,322 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:55,322 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:55,322 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. started... 2023-07-24 23:06:55,322 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(162): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,322 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,322 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:55,322 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,322 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:55,324 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:55,324 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:55,324 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:55,324 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:55,324 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ad36a0a8bdfd67e5e530c6ee5d2423ac: 2023-07-24 23:06:55,324 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. started... 2023-07-24 23:06:55,324 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,324 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 813638e7966319ffcf7afe9843d3ddb5: 2023-07-24 23:06:55,325 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:55,325 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:55,325 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,325 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:55,325 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:06:55,334 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:55,334 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:55,334 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:55,345 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:55,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 23:06:55,346 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:55,346 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:55,348 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. completed. 2023-07-24 23:06:55,348 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:55,348 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:55,348 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:55,348 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,348 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:55,348 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:06:55,349 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. completed. 2023-07-24 23:06:55,349 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:55,349 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:55,349 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:55,349 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,349 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:55,349 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:06:55,350 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:55,350 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:55,350 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:55,350 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:55,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:55,352 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:55,352 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:55,352 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:55,352 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:55,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:55,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:55,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:06:55,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 23:06:55,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:55,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:55,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:55,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:55,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:55,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34249,1690239969818': 2023-07-24 23:06:55,361 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' released barrier for procedure'emptySnaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 23:06:55,361 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testConsecutiveExports' execution completed 2023-07-24 23:06:55,361 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:55,361 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:55,361 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,361 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:55,364 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,364 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,364 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:55,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:55,364 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,365 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,365 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:55,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,366 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:55,367 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,369 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:55,369 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,369 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,369 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,370 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,371 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,373 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,373 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,373 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,373 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,373 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,373 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,373 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,373 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 23:06:55,373 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,373 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,373 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,373 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,374 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,374 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 23:06:55,375 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,385 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,386 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,401 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,421 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 23:06:55,421 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,422 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testConsecutiveExports 2023-07-24 23:06:55,422 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690240015242Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690240015385 (+143 ms)Consolidate snapshot: emptySnaptb0-testConsecutiveExports at 1690240015385Loading Region manifests for emptySnaptb0-testConsecutiveExports at 1690240015385Writing data manifest for emptySnaptb0-testConsecutiveExports at 1690240015388 (+3 ms)Verifying snapshot: emptySnaptb0-testConsecutiveExports at 1690240015396 (+8 ms)Snapshot emptySnaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690240015421 (+25 ms) 2023-07-24 23:06:55,426 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:55,428 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 182 msec 2023-07-24 23:06:55,547 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:55,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 23:06:55,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:55,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34249] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:55,552 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39257] regionserver.HRegion(8805): writing data to region testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:06:55,555 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testConsecutiveExports 2023-07-24 23:06:55,555 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:55,555 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:06:55,566 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:55,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240015566 (current time:1690240015566). 2023-07-24 23:06:55,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:06:55,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x44251b07 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:55,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7281ff5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:55,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:55,583 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36542, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:55,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x44251b07 to 127.0.0.1:58202 2023-07-24 23:06:55,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:55,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x155765a6 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:06:55,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7946b928, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:06:55,592 DEBUG [hconnection-0x3e56c642-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:55,595 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36556, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:55,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:06:55,600 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37550, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:06:55,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x155765a6 to 127.0.0.1:58202 2023-07-24 23:06:55,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:06:55,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testConsecutiveExports], kv [jenkins: RWXCA] 2023-07-24 23:06:55,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:06:55,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:55,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:55,606 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=49, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:55,606 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=49, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE; timeout=600000, timestamp=1690240615606 2023-07-24 23:06:55,607 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports 2023-07-24 23:06:55,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } 2023-07-24 23:06:55,608 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:06:55,608 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:06:55,608 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:55,609 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=49, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE 2023-07-24 23:06:55,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=49, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=EXCLUSIVE in 5 msec 2023-07-24 23:06:55,611 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=50, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:55,612 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=50, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED; timeout=600000, timestamp=1690240615612 2023-07-24 23:06:55,625 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testConsecutiveExports 2023-07-24 23:06:55,625 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testConsecutiveExports' 2023-07-24 23:06:55,625 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:55,627 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testConsecutiveExports' starting 'acquire' 2023-07-24 23:06:55,627 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testConsecutiveExports', kicking off acquire phase on members. 2023-07-24 23:06:55,627 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,627 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,629 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,629 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,629 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,629 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,629 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,629 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,629 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,629 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,630 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,630 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 160 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,630 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:55,631 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testConsecutiveExports from table testtb-testConsecutiveExports type FLUSH 2023-07-24 23:06:55,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 23:06:55,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 23:06:55,631 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:55,631 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:55,631 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:55,631 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testConsecutiveExports 2023-07-24 23:06:55,632 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:55,632 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:55,632 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testConsecutiveExports' with timeout 300000ms 2023-07-24 23:06:55,631 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:55,632 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:06:55,633 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:55,634 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testConsecutiveExports' starting 'acquire' stage 2023-07-24 23:06:55,634 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:55,635 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:55,632 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:55,634 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testConsecutiveExports' locally acquired 2023-07-24 23:06:55,635 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (snaptb0-testConsecutiveExports) in zk 2023-07-24 23:06:55,636 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,636 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:55,636 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:55,638 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,638 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:55,638 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,638 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,638 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:55,638 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:55,638 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,638 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:55,638 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testConsecutiveExports' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:06:55,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:55,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,639 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:55,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 23:06:55,640 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@754ddbdf[Count = 1] remaining members to acquire global barrier 2023-07-24 23:06:55,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:55,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:55,640 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:55,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:55,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:55,641 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,642 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:55,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure 'snaptb0-testConsecutiveExports' on coordinator 2023-07-24 23:06:55,643 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@754ddbdf[Count = 0] remaining members to acquire global barrier 2023-07-24 23:06:55,643 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testConsecutiveExports' starting 'in-barrier' execution. 2023-07-24 23:06:55,643 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,644 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,644 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,644 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,644 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,645 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,644 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:55,645 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:55,645 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:55,645 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testConsecutiveExports' received 'reached' from coordinator. 2023-07-24 23:06:55,645 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:06:55,645 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:55,645 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,645 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:55,645 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:55,645 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. started... 2023-07-24 23:06:55,645 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:55,645 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:06:55,645 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:06:55,645 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. started... 2023-07-24 23:06:55,645 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2745): Flushing ad36a0a8bdfd67e5e530c6ee5d2423ac 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 23:06:55,645 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:06:55,646 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 813638e7966319ffcf7afe9843d3ddb5 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 23:06:55,647 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:55,647 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:55,648 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:55,669 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307240b2b313921344fb39d081a71fcf1f0bc to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307240b2b313921344fb39d081a71fcf1f0bc 2023-07-24 23:06:55,670 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023072424c1006c561149fea327a3a9ad609265 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072424c1006c561149fea327a3a9ad609265 2023-07-24 23:06:55,682 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/.tmp/cf/e8e68f1e7cdd473abc6a9853161d6a7e 2023-07-24 23:06:55,683 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/.tmp/cf/55419fd1d244479ea0abc62932584308 2023-07-24 23:06:55,692 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/.tmp/cf/55419fd1d244479ea0abc62932584308 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/cf/55419fd1d244479ea0abc62932584308 2023-07-24 23:06:55,692 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/.tmp/cf/e8e68f1e7cdd473abc6a9853161d6a7e as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/cf/e8e68f1e7cdd473abc6a9853161d6a7e 2023-07-24 23:06:55,698 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/cf/55419fd1d244479ea0abc62932584308, entries=3, sequenceid=6, filesize=5.4 K 2023-07-24 23:06:55,698 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/cf/e8e68f1e7cdd473abc6a9853161d6a7e, entries=47, sequenceid=6, filesize=12.7 K 2023-07-24 23:06:55,699 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 813638e7966319ffcf7afe9843d3ddb5 in 53ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:55,699 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for ad36a0a8bdfd67e5e530c6ee5d2423ac in 54ms, sequenceid=6, compaction requested=false 2023-07-24 23:06:55,699 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 23:06:55,699 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testConsecutiveExports' 2023-07-24 23:06:55,701 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 813638e7966319ffcf7afe9843d3ddb5: 2023-07-24 23:06:55,701 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for ad36a0a8bdfd67e5e530c6ee5d2423ac: 2023-07-24 23:06:55,701 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 23:06:55,701 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:55,701 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/cf/e8e68f1e7cdd473abc6a9853161d6a7e] hfiles 2023-07-24 23:06:55,701 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 23:06:55,701 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/cf/e8e68f1e7cdd473abc6a9853161d6a7e for snapshot=snaptb0-testConsecutiveExports 2023-07-24 23:06:55,702 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:06:55,702 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/cf/55419fd1d244479ea0abc62932584308] hfiles 2023-07-24 23:06:55,702 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/cf/55419fd1d244479ea0abc62932584308 for snapshot=snaptb0-testConsecutiveExports 2023-07-24 23:06:55,708 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:55,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 23:06:55,709 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:06:55,709 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:06:55,718 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. completed. 2023-07-24 23:06:55,718 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:06:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:55,718 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. completed. 2023-07-24 23:06:55,718 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:06:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:06:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:06:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:06:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testConsecutiveExports' locally completed 2023-07-24 23:06:55,718 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testConsecutiveExports' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:06:55,720 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,720 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:55,720 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,720 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:55,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,720 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testConsecutiveExports' has notified controller of completion 2023-07-24 23:06:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:55,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:55,720 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:55,721 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:55,721 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testConsecutiveExports' completed. 2023-07-24 23:06:55,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:55,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:06:55,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 1 more 2023-07-24 23:06:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:55,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:55,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:55,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:55,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testConsecutiveExports' member 'jenkins-hbase4.apache.org,34249,1690239969818': 2023-07-24 23:06:55,729 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' released barrier for procedure'snaptb0-testConsecutiveExports', counting down latch. Waiting for 0 more 2023-07-24 23:06:55,729 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testConsecutiveExports' execution completed 2023-07-24 23:06:55,729 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:06:55,729 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:06:55,729 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testConsecutiveExports 2023-07-24 23:06:55,729 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testConsecutiveExportsincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:06:55,731 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,731 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:06:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:06:55,731 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,731 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,731 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:06:55,731 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,731 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,731 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,731 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,732 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:06:55,732 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:06:55,734 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testConsecutiveExports 2023-07-24 23:06:55,734 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,734 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,735 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,735 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,741 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,741 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,741 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,741 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:06:55,742 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testConsecutiveExports 2023-07-24 23:06:55,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,742 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,742 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:06:55,741 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:06:55,741 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,741 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:06:55,742 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testConsecutiveExports 2023-07-24 23:06:55,743 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => c7b48a2e62736c517f8bfa7d64fc37ac, NAME => 'testtb-testConsecutiveExports,.mob,0.c7b48a2e62736c517f8bfa7d64fc37ac.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testConsecutiveExports 2023-07-24 23:06:55,743 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:06:55,743 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:06:55,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,743 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,743 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,744 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:06:55,744 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:06:55,744 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:06:55,744 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,744 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:06:55,744 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:06:55,744 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,744 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072424c1006c561149fea327a3a9ad609265, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307240b2b313921344fb39d081a71fcf1f0bc] mob files 2023-07-24 23:06:55,744 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072424c1006c561149fea327a3a9ad609265 2023-07-24 23:06:55,745 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307240b2b313921344fb39d081a71fcf1f0bc 2023-07-24 23:06:55,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testConsecutiveExports 2023-07-24 23:06:55,759 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,781 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,799 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed 2023-07-24 23:06:55,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,800 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,800 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testConsecutiveExports C_M_SNAPSHOT_TABLE on table testtb-testConsecutiveExports at 1690240015607Completed referencing HFiles for the mob region of table: testtb-testConsecutiveExports at 1690240015759 (+152 ms)Consolidate snapshot: snaptb0-testConsecutiveExports at 1690240015759Loading Region manifests for snaptb0-testConsecutiveExports at 1690240015759Writing data manifest for snaptb0-testConsecutiveExports at 1690240015764 (+5 ms)Verifying snapshot: snaptb0-testConsecutiveExports at 1690240015774 (+10 ms)Snapshot snaptb0-testConsecutiveExports of table testtb-testConsecutiveExports completed at 1690240015799 (+25 ms) 2023-07-24 23:06:55,803 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=50, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED 2023-07-24 23:06:55,804 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=50, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testConsecutiveExports, type=SHARED in 196 msec 2023-07-24 23:06:55,910 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:06:55,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 } is done 2023-07-24 23:06:55,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testConsecutiveExports table=testtb-testConsecutiveExports type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:06:55,911 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(389): Local export destination path: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911 2023-07-24 23:06:55,911 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911, srcFsUri=hdfs://localhost:33513, srcDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:06:55,934 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:06:55,934 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@2343cda1, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,934 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316, snapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 23:06:55,945 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:06:55,956 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:55,957 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:55,957 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:55,958 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:55,958 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:55,958 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:55,959 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:56,029 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop-8221084259148864231.jar 2023-07-24 23:06:56,030 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:56,030 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:56,031 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:56,031 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:56,032 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:56,032 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:06:56,033 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:06:56,034 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:06:56,034 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:06:56,035 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:06:56,035 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:06:56,036 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:06:56,036 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:06:56,036 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:06:56,036 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:06:56,037 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:06:56,037 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:56,038 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:56,038 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:56,038 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:56,039 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:06:56,039 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:56,039 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:06:56,405 WARN [Listener at jenkins-hbase4.apache.org/36985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:06:56,407 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 23:06:56,409 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 23:06:59,018 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:59,019 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:06:59,022 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0002_000001 (auth:SIMPLE) 2023-07-24 23:06:59,812 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:06:59,854 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0003_000001 (auth:SIMPLE) 2023-07-24 23:07:04,378 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0003_000001 (auth:SIMPLE) 2023-07-24 23:07:06,626 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0003_000001 (auth:SIMPLE) 2023-07-24 23:07:09,227 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0003_000001 (auth:SIMPLE) 2023-07-24 23:07:10,610 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:07:10,610 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:07:10,616 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 23:07:10,616 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:07:10,616 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:07:10,617 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 23:07:10,617 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 23:07:10,617 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 23:07:10,617 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@396e022b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 23:07:10,618 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 23:07:10,618 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 23:07:10,619 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(255): tgtFsUri=file:///, tgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911, rawTgtDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911, srcFsUri=hdfs://localhost:33513, srcDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:07:10,640 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:07:10,640 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(999): outputFs=org.apache.hadoop.fs.LocalFileSystem@425b88ac, outputRoot=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911, skipTmp=false, initialOutputSnapshotDir=file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:07:10,640 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316, snapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports. 2023-07-24 23:07:10,651 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports to file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/.tmp/snaptb0-testConsecutiveExports 2023-07-24 23:07:10,662 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,662 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,663 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,663 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,663 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,663 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,664 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,731 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop-3720322471536887713.jar 2023-07-24 23:07:10,731 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,732 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,732 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,732 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,733 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,733 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:10,733 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:07:10,734 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:07:10,734 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:07:10,735 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:07:10,735 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:07:10,735 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:07:10,736 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:07:10,736 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:07:10,736 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:07:10,737 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:07:10,737 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:10,737 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:10,738 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:10,738 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:10,738 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:10,739 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:10,739 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:11,968 WARN [Listener at jenkins-hbase4.apache.org/36985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:07:11,970 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testConsecutiveExports' hfile list 2023-07-24 23:07:11,972 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(671): export split=0 size=30.8 K 2023-07-24 23:07:15,414 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:15,414 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:15,417 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0003_000001 (auth:SIMPLE) 2023-07-24 23:07:16,034 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0004_000001 (auth:SIMPLE) 2023-07-24 23:07:20,640 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0004_000001 (auth:SIMPLE) 2023-07-24 23:07:22,896 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0004_000001 (auth:SIMPLE) 2023-07-24 23:07:26,458 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0004_000001 (auth:SIMPLE) 2023-07-24 23:07:28,194 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:07:28,195 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:07:28,207 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testConsecutiveExports 2023-07-24 23:07:28,207 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:07:28,207 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:07:28,208 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 23:07:28,217 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 23:07:28,217 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 23:07:28,218 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in org.apache.hadoop.fs.LocalFileSystem@396e022b in root file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/snaptb0-testConsecutiveExports at file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/snaptb0-testConsecutiveExports 2023-07-24 23:07:28,218 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/snaptb0-testConsecutiveExports/data.manifest 2023-07-24 23:07:28,218 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/local-export-1690240015911/.hbase-snapshot/snaptb0-testConsecutiveExports/.snapshotinfo 2023-07-24 23:07:28,237 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$15(890): Started disable of testtb-testConsecutiveExports 2023-07-24 23:07:28,238 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testConsecutiveExports 2023-07-24 23:07:28,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=51, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:28,245 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240048244"}]},"ts":"1690240048244"} 2023-07-24 23:07:28,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 23:07:28,247 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLING in hbase:meta 2023-07-24 23:07:28,249 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set testtb-testConsecutiveExports to state=DISABLING 2023-07-24 23:07:28,250 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=813638e7966319ffcf7afe9843d3ddb5, UNASSIGN}, {pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad36a0a8bdfd67e5e530c6ee5d2423ac, UNASSIGN}] 2023-07-24 23:07:28,252 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=52, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=813638e7966319ffcf7afe9843d3ddb5, UNASSIGN 2023-07-24 23:07:28,252 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=53, ppid=51, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad36a0a8bdfd67e5e530c6ee5d2423ac, UNASSIGN 2023-07-24 23:07:28,257 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=813638e7966319ffcf7afe9843d3ddb5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:28,257 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ad36a0a8bdfd67e5e530c6ee5d2423ac, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:28,257 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240048257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240048257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240048257"}]},"ts":"1690240048257"} 2023-07-24 23:07:28,257 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240048257"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240048257"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240048257"}]},"ts":"1690240048257"} 2023-07-24 23:07:28,259 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=54, ppid=52, state=RUNNABLE; CloseRegionProcedure 813638e7966319ffcf7afe9843d3ddb5, server=jenkins-hbase4.apache.org,34249,1690239969818}] 2023-07-24 23:07:28,260 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=55, ppid=53, state=RUNNABLE; CloseRegionProcedure ad36a0a8bdfd67e5e530c6ee5d2423ac, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:07:28,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 23:07:28,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:07:28,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 813638e7966319ffcf7afe9843d3ddb5, disabling compactions & flushes 2023-07-24 23:07:28,414 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:07:28,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:07:28,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. after waiting 0 ms 2023-07-24 23:07:28,414 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:07:28,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:07:28,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ad36a0a8bdfd67e5e530c6ee5d2423ac, disabling compactions & flushes 2023-07-24 23:07:28,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:07:28,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:07:28,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. after waiting 0 ms 2023-07-24 23:07:28,418 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:07:28,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:07:28,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:28,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:07:28,437 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:28,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac. 2023-07-24 23:07:28,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ad36a0a8bdfd67e5e530c6ee5d2423ac: 2023-07-24 23:07:28,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5. 2023-07-24 23:07:28,439 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 813638e7966319ffcf7afe9843d3ddb5: 2023-07-24 23:07:28,443 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:07:28,444 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=53 updating hbase:meta row=ad36a0a8bdfd67e5e530c6ee5d2423ac, regionState=CLOSED 2023-07-24 23:07:28,444 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240048444"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240048444"}]},"ts":"1690240048444"} 2023-07-24 23:07:28,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:07:28,447 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=52 updating hbase:meta row=813638e7966319ffcf7afe9843d3ddb5, regionState=CLOSED 2023-07-24 23:07:28,447 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1690240048447"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240048447"}]},"ts":"1690240048447"} 2023-07-24 23:07:28,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=55, resume processing ppid=53 2023-07-24 23:07:28,466 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=55, ppid=53, state=SUCCESS; CloseRegionProcedure ad36a0a8bdfd67e5e530c6ee5d2423ac, server=jenkins-hbase4.apache.org,39257,1690239969778 in 187 msec 2023-07-24 23:07:28,468 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=54, resume processing ppid=52 2023-07-24 23:07:28,469 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=54, ppid=52, state=SUCCESS; CloseRegionProcedure 813638e7966319ffcf7afe9843d3ddb5, server=jenkins-hbase4.apache.org,34249,1690239969818 in 197 msec 2023-07-24 23:07:28,470 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=53, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=ad36a0a8bdfd67e5e530c6ee5d2423ac, UNASSIGN in 216 msec 2023-07-24 23:07:28,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=52, resume processing ppid=51 2023-07-24 23:07:28,473 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=52, ppid=51, state=SUCCESS; TransitRegionStateProcedure table=testtb-testConsecutiveExports, region=813638e7966319ffcf7afe9843d3ddb5, UNASSIGN in 219 msec 2023-07-24 23:07:28,479 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240048479"}]},"ts":"1690240048479"} 2023-07-24 23:07:28,483 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testConsecutiveExports, state=DISABLED in hbase:meta 2023-07-24 23:07:28,485 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set testtb-testConsecutiveExports to state=DISABLED 2023-07-24 23:07:28,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=51, state=SUCCESS; DisableTableProcedure table=testtb-testConsecutiveExports in 248 msec 2023-07-24 23:07:28,549 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=51 2023-07-24 23:07:28,550 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testConsecutiveExports, procId: 51 completed 2023-07-24 23:07:28,551 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testConsecutiveExports 2023-07-24 23:07:28,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:28,562 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=56, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:28,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(259): Removing permissions of removed table testtb-testConsecutiveExports 2023-07-24 23:07:28,565 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=56, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:28,570 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testConsecutiveExports 2023-07-24 23:07:28,573 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:28,573 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:28,573 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:28,574 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 23:07:28,574 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 23:07:28,574 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:28,575 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 23:07:28,576 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testConsecutiveExports with data PBUF 2023-07-24 23:07:28,578 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:07:28,578 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:28,578 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:28,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 23:07:28,580 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/recovered.edits] 2023-07-24 23:07:28,582 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:28,582 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:28,583 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:28,583 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testConsecutiveExports 2023-07-24 23:07:28,583 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:28,583 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:28,586 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:07:28,593 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/cf/e8e68f1e7cdd473abc6a9853161d6a7e to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/cf/e8e68f1e7cdd473abc6a9853161d6a7e 2023-07-24 23:07:28,593 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/recovered.edits] 2023-07-24 23:07:28,598 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac/recovered.edits/9.seqid 2023-07-24 23:07:28,599 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/ad36a0a8bdfd67e5e530c6ee5d2423ac 2023-07-24 23:07:28,603 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/cf/55419fd1d244479ea0abc62932584308 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/cf/55419fd1d244479ea0abc62932584308 2023-07-24 23:07:28,613 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5/recovered.edits/9.seqid 2023-07-24 23:07:28,613 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testConsecutiveExports/813638e7966319ffcf7afe9843d3ddb5 2023-07-24 23:07:28,614 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testConsecutiveExports regions 2023-07-24 23:07:28,614 DEBUG [PEWorker-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 23:07:28,615 DEBUG [PEWorker-1] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf] 2023-07-24 23:07:28,620 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072424c1006c561149fea327a3a9ad609265 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/c4ca4238a0b923820dcc509a6f75849b2023072424c1006c561149fea327a3a9ad609265 2023-07-24 23:07:28,623 DEBUG [PEWorker-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307240b2b313921344fb39d081a71fcf1f0bc to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac/cf/d41d8cd98f00b204e9800998ecf8427e202307240b2b313921344fb39d081a71fcf1f0bc 2023-07-24 23:07:28,623 DEBUG [PEWorker-1] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testConsecutiveExports/c7b48a2e62736c517f8bfa7d64fc37ac 2023-07-24 23:07:28,635 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=56, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:28,640 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testConsecutiveExports from hbase:meta 2023-07-24 23:07:28,646 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'testtb-testConsecutiveExports' descriptor. 2023-07-24 23:07:28,648 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=56, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:28,648 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'testtb-testConsecutiveExports' from region states. 2023-07-24 23:07:28,648 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240048648"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:28,648 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240048648"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:28,652 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:07:28,652 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 813638e7966319ffcf7afe9843d3ddb5, NAME => 'testtb-testConsecutiveExports,,1690240014533.813638e7966319ffcf7afe9843d3ddb5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => ad36a0a8bdfd67e5e530c6ee5d2423ac, NAME => 'testtb-testConsecutiveExports,1,1690240014533.ad36a0a8bdfd67e5e530c6ee5d2423ac.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:07:28,652 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'testtb-testConsecutiveExports' as deleted. 2023-07-24 23:07:28,653 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testConsecutiveExports","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240048652"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:28,655 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table testtb-testConsecutiveExports state from META 2023-07-24 23:07:28,663 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=56, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testConsecutiveExports 2023-07-24 23:07:28,666 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=56, state=SUCCESS; DeleteTableProcedure table=testtb-testConsecutiveExports in 112 msec 2023-07-24 23:07:28,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=56 2023-07-24 23:07:28,681 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testConsecutiveExports, procId: 56 completed 2023-07-24 23:07:28,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testConsecutiveExports" 2023-07-24 23:07:28,695 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testConsecutiveExports 2023-07-24 23:07:28,698 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testConsecutiveExports" 2023-07-24 23:07:28,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testConsecutiveExports 2023-07-24 23:07:28,741 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testConsecutiveExports Thread=746 (was 759), OpenFileDescriptor=899 (was 937), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=446 (was 380) - SystemLoadAverage LEAK? -, ProcessCount=182 (was 180) - ProcessCount LEAK? -, AvailableMemoryMB=5415 (was 5713) 2023-07-24 23:07:28,742 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-24 23:07:28,769 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=746, OpenFileDescriptor=899, MaxFileDescriptor=60000, SystemLoadAverage=446, ProcessCount=182, AvailableMemoryMB=5416 2023-07-24 23:07:28,769 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=746 is superior to 500 2023-07-24 23:07:28,773 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 23:07:28,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:28,781 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:07:28,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion" procId is: 57 2023-07-24 23:07:28,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 23:07:28,786 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:07:28,790 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:28,791 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3 empty. 2023-07-24 23:07:28,791 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:28,792 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38 2023-07-24 23:07:28,797 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38 empty. 2023-07-24 23:07:28,798 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38 2023-07-24 23:07:28,798 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 23:07:28,841 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/.tabledesc/.tableinfo.0000000001 2023-07-24 23:07:28,842 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(7675): creating {ENCODED => 20b1dfa0af010020aa404362650b7fd3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:07:28,843 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(7675): creating {ENCODED => 002333a312ee3328d37909db42818f38, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:07:28,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 23:07:28,901 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:28,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1604): Closing 20b1dfa0af010020aa404362650b7fd3, disabling compactions & flushes 2023-07-24 23:07:28,902 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:28,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:28,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. after waiting 0 ms 2023-07-24 23:07:28,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:28,902 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:28,902 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-0] regionserver.HRegion(1558): Region close journal for 20b1dfa0af010020aa404362650b7fd3: 2023-07-24 23:07:29,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 23:07:29,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:29,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1604): Closing 002333a312ee3328d37909db42818f38, disabling compactions & flushes 2023-07-24 23:07:29,296 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:29,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:29,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. after waiting 0 ms 2023-07-24 23:07:29,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:29,296 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:29,296 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-pool-1] regionserver.HRegion(1558): Region close journal for 002333a312ee3328d37909db42818f38: 2023-07-24 23:07:29,298 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:07:29,299 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240049299"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240049299"}]},"ts":"1690240049299"} 2023-07-24 23:07:29,299 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240049299"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240049299"}]},"ts":"1690240049299"} 2023-07-24 23:07:29,305 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:07:29,306 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:07:29,306 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240049306"}]},"ts":"1690240049306"} 2023-07-24 23:07:29,308 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLING in hbase:meta 2023-07-24 23:07:29,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 23:07:29,407 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:07:29,408 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:07:29,408 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:07:29,408 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:07:29,408 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:07:29,409 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b1dfa0af010020aa404362650b7fd3, ASSIGN}, {pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=002333a312ee3328d37909db42818f38, ASSIGN}] 2023-07-24 23:07:29,411 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=002333a312ee3328d37909db42818f38, ASSIGN 2023-07-24 23:07:29,411 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b1dfa0af010020aa404362650b7fd3, ASSIGN 2023-07-24 23:07:29,412 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=59, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=002333a312ee3328d37909db42818f38, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42121,1690239969723; forceNewPlan=false, retain=false 2023-07-24 23:07:29,412 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=58, ppid=57, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b1dfa0af010020aa404362650b7fd3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39257,1690239969778; forceNewPlan=false, retain=false 2023-07-24 23:07:29,562 INFO [jenkins-hbase4:40271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:07:29,565 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=20b1dfa0af010020aa404362650b7fd3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:29,565 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=002333a312ee3328d37909db42818f38, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:29,565 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240049565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240049565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240049565"}]},"ts":"1690240049565"} 2023-07-24 23:07:29,565 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240049565"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240049565"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240049565"}]},"ts":"1690240049565"} 2023-07-24 23:07:29,567 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=60, ppid=58, state=RUNNABLE; OpenRegionProcedure 20b1dfa0af010020aa404362650b7fd3, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:07:29,568 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=61, ppid=59, state=RUNNABLE; OpenRegionProcedure 002333a312ee3328d37909db42818f38, server=jenkins-hbase4.apache.org,42121,1690239969723}] 2023-07-24 23:07:29,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:29,728 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 20b1dfa0af010020aa404362650b7fd3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:07:29,728 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 002333a312ee3328d37909db42818f38, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:07:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. service=AccessControlService 2023-07-24 23:07:29,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. service=AccessControlService 2023-07-24 23:07:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:29,729 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion 002333a312ee3328d37909db42818f38 2023-07-24 23:07:29,729 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:29,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 002333a312ee3328d37909db42818f38 2023-07-24 23:07:29,730 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 002333a312ee3328d37909db42818f38 2023-07-24 23:07:29,730 INFO [StoreOpener-20b1dfa0af010020aa404362650b7fd3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:29,733 INFO [StoreOpener-002333a312ee3328d37909db42818f38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 002333a312ee3328d37909db42818f38 2023-07-24 23:07:29,735 DEBUG [StoreOpener-20b1dfa0af010020aa404362650b7fd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/cf 2023-07-24 23:07:29,735 DEBUG [StoreOpener-002333a312ee3328d37909db42818f38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/cf 2023-07-24 23:07:29,735 DEBUG [StoreOpener-002333a312ee3328d37909db42818f38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/cf 2023-07-24 23:07:29,735 DEBUG [StoreOpener-20b1dfa0af010020aa404362650b7fd3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/cf 2023-07-24 23:07:29,736 INFO [StoreOpener-002333a312ee3328d37909db42818f38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 002333a312ee3328d37909db42818f38 columnFamilyName cf 2023-07-24 23:07:29,736 INFO [StoreOpener-20b1dfa0af010020aa404362650b7fd3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 20b1dfa0af010020aa404362650b7fd3 columnFamilyName cf 2023-07-24 23:07:29,737 INFO [StoreOpener-002333a312ee3328d37909db42818f38-1] regionserver.HStore(310): Store=002333a312ee3328d37909db42818f38/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:29,737 INFO [StoreOpener-20b1dfa0af010020aa404362650b7fd3-1] regionserver.HStore(310): Store=20b1dfa0af010020aa404362650b7fd3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:29,738 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:29,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38 2023-07-24 23:07:29,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:29,739 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38 2023-07-24 23:07:29,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:29,742 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 002333a312ee3328d37909db42818f38 2023-07-24 23:07:29,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:29,747 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 20b1dfa0af010020aa404362650b7fd3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62531881, jitterRate=-0.06820236146450043}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:29,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:29,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 20b1dfa0af010020aa404362650b7fd3: 2023-07-24 23:07:29,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 002333a312ee3328d37909db42818f38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64339319, jitterRate=-0.04126943647861481}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:29,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 002333a312ee3328d37909db42818f38: 2023-07-24 23:07:29,748 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38., pid=61, masterSystemTime=1690240049722 2023-07-24 23:07:29,750 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:29,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:29,751 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=59 updating hbase:meta row=002333a312ee3328d37909db42818f38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:29,751 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240049750"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240049750"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240049750"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240049750"}]},"ts":"1690240049750"} 2023-07-24 23:07:29,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=61, resume processing ppid=59 2023-07-24 23:07:29,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=61, ppid=59, state=SUCCESS; OpenRegionProcedure 002333a312ee3328d37909db42818f38, server=jenkins-hbase4.apache.org,42121,1690239969723 in 184 msec 2023-07-24 23:07:29,755 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3., pid=60, masterSystemTime=1690240049722 2023-07-24 23:07:29,757 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=59, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=002333a312ee3328d37909db42818f38, ASSIGN in 346 msec 2023-07-24 23:07:29,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:29,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:29,758 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=58 updating hbase:meta row=20b1dfa0af010020aa404362650b7fd3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:29,758 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240049758"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240049758"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240049758"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240049758"}]},"ts":"1690240049758"} 2023-07-24 23:07:29,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=60, resume processing ppid=58 2023-07-24 23:07:29,764 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=60, ppid=58, state=SUCCESS; OpenRegionProcedure 20b1dfa0af010020aa404362650b7fd3, server=jenkins-hbase4.apache.org,39257,1690239969778 in 193 msec 2023-07-24 23:07:29,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=58, resume processing ppid=57 2023-07-24 23:07:29,766 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=58, ppid=57, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b1dfa0af010020aa404362650b7fd3, ASSIGN in 355 msec 2023-07-24 23:07:29,767 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:07:29,767 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240049767"}]},"ts":"1690240049767"} 2023-07-24 23:07:29,768 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=ENABLED in hbase:meta 2023-07-24 23:07:29,838 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=57, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:07:29,839 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion jenkins: RWXCA 2023-07-24 23:07:29,844 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 23:07:29,884 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:29,884 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:29,884 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:29,884 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:29,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 23:07:29,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,932 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:29,960 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=57, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 1.1590 sec 2023-07-24 23:07:30,132 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion' 2023-07-24 23:07:30,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=57 2023-07-24 23:07:30,906 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 57 completed 2023-07-24 23:07:30,908 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:30,909 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:30,910 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:07:30,933 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:30,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240050933 (current time:1690240050933). 2023-07-24 23:07:30,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:07:30,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x095857f8 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:30,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5dd4d7aa, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:30,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:30,955 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35626, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:30,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x095857f8 to 127.0.0.1:58202 2023-07-24 23:07:30,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:30,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x4cc198ef to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:30,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@76df118, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:30,964 DEBUG [hconnection-0x7cff0fd8-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:30,965 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35640, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:30,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:30,971 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:30,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4cc198ef to 127.0.0.1:58202 2023-07-24 23:07:30,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:30,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 23:07:30,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:07:30,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:30,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:30,976 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=62, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:30,977 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=62, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690240650977 2023-07-24 23:07:30,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:30,977 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:30,978 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:07:30,979 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:07:30,979 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:30,980 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=62, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:30,984 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=62, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 6 msec 2023-07-24 23:07:30,985 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=63, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:30,989 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=63, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690240650989 2023-07-24 23:07:31,022 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,023 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 23:07:31,023 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:31,024 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 23:07:31,025 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 23:07:31,025 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,025 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,027 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,027 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,027 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,027 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,027 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,028 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,028 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,028 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,028 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:07:31,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,028 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 23:07:31,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 23:07:31,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 219 2023-07-24 23:07:31,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:31,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:31,029 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:31,029 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,029 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:31,030 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:31,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:31,032 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:31,032 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:31,033 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:31,033 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:31,033 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:31,033 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:31,035 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:31,035 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:31,035 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:31,046 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,046 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:31,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:31,047 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,053 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,053 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:31,053 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,053 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:31,054 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:31,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 23:07:31,056 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2404c84c[Count = 1] remaining members to acquire global barrier 2023-07-24 23:07:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:31,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:31,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 23:07:31,058 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2404c84c[Count = 0] remaining members to acquire global barrier 2023-07-24 23:07:31,058 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 23:07:31,058 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,061 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,061 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,061 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,061 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:31,061 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,061 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:31,061 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:31,061 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:31,061 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:07:31,062 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,062 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:07:31,064 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:31,064 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:31,064 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:31,065 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. started... 2023-07-24 23:07:31,065 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20b1dfa0af010020aa404362650b7fd3: 2023-07-24 23:07:31,065 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,065 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:31,065 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:07:31,070 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:31,070 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:31,070 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:31,070 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. started... 2023-07-24 23:07:31,072 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 002333a312ee3328d37909db42818f38: 2023-07-24 23:07:31,072 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,072 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:31,072 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:07:31,073 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:31,073 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:31,073 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:31,088 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:31,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:31,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:31,089 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:07:31,162 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. completed. 2023-07-24 23:07:31,162 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:31,162 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:31,162 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:31,162 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,162 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:31,162 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:07:31,164 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,164 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:31,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:31,165 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:31,164 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:31,165 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:31,166 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. completed. 2023-07-24 23:07:31,166 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:31,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:31,166 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:31,167 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:31,167 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,167 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:31,167 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:07:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:31,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,172 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:31,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,172 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:31,172 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,172 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:31,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:31,178 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,180 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:07:31,181 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 23:07:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:31,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:31,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:31,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42121,1690239969723': 2023-07-24 23:07:31,188 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 23:07:31,188 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 23:07:31,188 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:07:31,188 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:07:31,188 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,188 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:07:31,191 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,191 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:31,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:31,191 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,191 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,191 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,192 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,192 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:31,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,192 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,193 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,193 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,196 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:31,196 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,198 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:31,199 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,201 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,201 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,205 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,205 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,205 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,205 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,206 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,206 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,206 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:31,205 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,206 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,208 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,208 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:31,208 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,208 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:31,208 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:31,208 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,208 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,206 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,206 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:31,208 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,206 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:31,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,209 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,209 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:07:31,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:31,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:31,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:31,210 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 23:07:31,243 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,244 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,290 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:31,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:31,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:31,292 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:07:31,303 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,592 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:31,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:31,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:31,594 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 23:07:31,737 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 23:07:31,737 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,738 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:31,738 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690240050977Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690240051243 (+266 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690240051243Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690240051243Writing data manifest for emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690240051253 (+10 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion at 1690240051285 (+32 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690240051737 (+452 ms) 2023-07-24 23:07:31,740 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=63, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:31,742 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=63, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 762 msec 2023-07-24 23:07:32,094 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:32,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:32,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:07:32,098 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39257] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:07:32,100 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42121] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:07:32,104 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,104 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:32,104 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:07:32,115 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:32,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240052115 (current time:1690240052115). 2023-07-24 23:07:32,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:07:32,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x3622f5b4 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:32,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@480e6ee6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:32,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:32,127 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:32,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3622f5b4 to 127.0.0.1:58202 2023-07-24 23:07:32,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:32,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x4e7e2603 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:32,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6fd0f52d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:32,138 DEBUG [hconnection-0x5412df6f-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:32,141 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35650, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:32,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:32,146 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:32,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e7e2603 to 127.0.0.1:58202 2023-07-24 23:07:32,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:32,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion], kv [jenkins: RWXCA] 2023-07-24 23:07:32,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:07:32,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:32,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:32,162 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:32,163 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE; timeout=600000, timestamp=1690240652163 2023-07-24 23:07:32,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } 2023-07-24 23:07:32,163 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,165 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:07:32,165 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:07:32,167 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:32,171 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE 2023-07-24 23:07:32,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=EXCLUSIVE in 20 msec 2023-07-24 23:07:32,175 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=65, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:32,176 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=65, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED; timeout=600000, timestamp=1690240652176 2023-07-24 23:07:32,263 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,263 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' 2023-07-24 23:07:32,263 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:32,265 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' 2023-07-24 23:07:32,265 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion', kicking off acquire phase on members. 2023-07-24 23:07:32,265 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,265 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,265 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:32,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:32,267 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:32,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:32,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:32,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:32,267 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:32,267 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,267 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:07:32,267 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:32,267 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:32,268 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,268 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,268 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,268 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,269 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,269 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:07:32,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,269 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 23:07:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,269 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 23:07:32,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:32,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 214 2023-07-24 23:07:32,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,270 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion from table testtb-testExportFileSystemStateWithMergeRegion type FLUSH 2023-07-24 23:07:32,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,271 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:32,271 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:32,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:32,276 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:32,276 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' with timeout 300000ms 2023-07-24 23:07:32,278 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:32,279 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'acquire' stage 2023-07-24 23:07:32,279 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally acquired 2023-07-24 23:07:32,280 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion) in zk 2023-07-24 23:07:32,287 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,287 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,287 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:32,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:32,287 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,287 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:32,287 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,287 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:32,289 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,289 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:32,290 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,290 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:32,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:32,290 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,291 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:32,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 23:07:32,292 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d552854[Count = 1] remaining members to acquire global barrier 2023-07-24 23:07:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:32,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:32,293 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:32,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:32,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,296 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,297 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:32,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' on coordinator 2023-07-24 23:07:32,297 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1d552854[Count = 0] remaining members to acquire global barrier 2023-07-24 23:07:32,297 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' starting 'in-barrier' execution. 2023-07-24 23:07:32,297 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,298 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,299 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,299 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,299 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:32,299 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,299 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,299 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:32,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,307 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,307 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' received 'reached' from coordinator. 2023-07-24 23:07:32,307 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:32,307 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:07:32,307 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,307 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:07:32,309 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:32,309 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:32,309 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:32,310 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:32,310 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:32,322 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:32,323 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:32,323 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:32,323 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. started... 2023-07-24 23:07:32,323 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 20b1dfa0af010020aa404362650b7fd3 1/1 column families, dataSize=199 B heapSize=688 B 2023-07-24 23:07:32,325 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:32,326 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. started... 2023-07-24 23:07:32,326 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 002333a312ee3328d37909db42818f38 1/1 column families, dataSize=3.06 KB heapSize=6.86 KB 2023-07-24 23:07:32,409 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20230724f5cffa14cbd74daba3cbf834eb4a9114 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724f5cffa14cbd74daba3cbf834eb4a9114 2023-07-24 23:07:32,415 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724903d922ae5d344a7977374c0c30d2848 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724903d922ae5d344a7977374c0c30d2848 2023-07-24 23:07:32,439 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=199, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/.tmp/cf/b591f8721cfc4a2aae894e303fcec61d 2023-07-24 23:07:32,442 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/.tmp/cf/0432e5a79cb240889cc3406d74d9ed99 2023-07-24 23:07:32,449 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/.tmp/cf/0432e5a79cb240889cc3406d74d9ed99 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/cf/0432e5a79cb240889cc3406d74d9ed99 2023-07-24 23:07:32,449 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/.tmp/cf/b591f8721cfc4a2aae894e303fcec61d as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/cf/b591f8721cfc4a2aae894e303fcec61d 2023-07-24 23:07:32,455 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/cf/b591f8721cfc4a2aae894e303fcec61d, entries=3, sequenceid=6, filesize=5.4 K 2023-07-24 23:07:32,457 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~199 B/199, heapSize ~672 B/672, currentSize=0 B/0 for 20b1dfa0af010020aa404362650b7fd3 in 134ms, sequenceid=6, compaction requested=false 2023-07-24 23:07:32,457 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/cf/0432e5a79cb240889cc3406d74d9ed99, entries=47, sequenceid=6, filesize=13.5 K 2023-07-24 23:07:32,458 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 20b1dfa0af010020aa404362650b7fd3: 2023-07-24 23:07:32,459 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,459 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:32,459 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/cf/b591f8721cfc4a2aae894e303fcec61d] hfiles 2023-07-24 23:07:32,459 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/cf/b591f8721cfc4a2aae894e303fcec61d for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,462 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.06 KB/3137, heapSize ~6.84 KB/7008, currentSize=0 B/0 for 002333a312ee3328d37909db42818f38 in 136ms, sequenceid=6, compaction requested=false 2023-07-24 23:07:32,462 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 002333a312ee3328d37909db42818f38: 2023-07-24 23:07:32,462 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,463 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:32,463 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/cf/0432e5a79cb240889cc3406d74d9ed99] hfiles 2023-07-24 23:07:32,463 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/cf/0432e5a79cb240889cc3406d74d9ed99 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,468 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:32,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:32,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:32,469 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:07:32,471 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. completed. 2023-07-24 23:07:32,471 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:32,471 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:32,471 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:32,471 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,471 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:32,471 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:07:32,473 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:32,473 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:32,473 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:32,480 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:32,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:32,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:32,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,507 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:32,510 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,512 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. completed. 2023-07-24 23:07:32,512 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' locally completed 2023-07-24 23:07:32,512 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:07:32,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,517 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:07:32,517 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' has notified controller of completion 2023-07-24 23:07:32,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 1 more 2023-07-24 23:07:32,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:32,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:32,518 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion' completed. 2023-07-24 23:07:32,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:32,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' member 'jenkins-hbase4.apache.org,42121,1690239969723': 2023-07-24 23:07:32,529 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion', counting down latch. Waiting for 0 more 2023-07-24 23:07:32,529 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion' execution completed 2023-07-24 23:07:32,529 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:07:32,529 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:07:32,529 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,529 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegionincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:07:32,535 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,535 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,535 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,535 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:32,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,535 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:32,535 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:32,535 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,535 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:32,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:32,537 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:32,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:32,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:32,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:32,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:32,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,538 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,539 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:32,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,546 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,547 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:32,549 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,553 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,553 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,553 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:32,553 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:32,553 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:32,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:32,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:32,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:32,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,554 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:32,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:32,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:32,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:32,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:32,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,555 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:32,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:32,555 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:32,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:32,554 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,554 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:32,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion because node does not exist (not an error) 2023-07-24 23:07:32,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:32,555 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:32,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:32,563 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,555 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => aaca68e56e63a701f5c1ec9dc2f0511c, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,.mob,0.aaca68e56e63a701f5c1ec9dc2f0511c.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,563 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,563 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:07:32,564 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724903d922ae5d344a7977374c0c30d2848, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724f5cffa14cbd74daba3cbf834eb4a9114] mob files 2023-07-24 23:07:32,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724903d922ae5d344a7977374c0c30d2848 2023-07-24 23:07:32,565 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724f5cffa14cbd74daba3cbf834eb4a9114 2023-07-24 23:07:32,584 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,586 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0004_000001 (auth:SIMPLE) 2023-07-24 23:07:32,626 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,666 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed 2023-07-24 23:07:32,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,667 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:32,667 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion at 1690240052164Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithMergeRegion at 1690240052584 (+420 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690240052584Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion at 1690240052584Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion at 1690240052596 (+12 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion at 1690240052613 (+17 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion of table testtb-testExportFileSystemStateWithMergeRegion completed at 1690240052666 (+53 ms) 2023-07-24 23:07:32,670 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=65, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED 2023-07-24 23:07:32,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=65, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion, type=SHARED in 505 msec 2023-07-24 23:07:32,769 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:32,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 } is done 2023-07-24 23:07:32,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion table=testtb-testExportFileSystemStateWithMergeRegion type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:07:32,806 DEBUG [Listener at jenkins-hbase4.apache.org/36985] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:07:32,813 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:07:32,816 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34249] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 23:07:32,816 DEBUG [Listener at jenkins-hbase4.apache.org/36985] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:07:32,823 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:07:32,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39257] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 23:07:32,824 DEBUG [Listener at jenkins-hbase4.apache.org/36985] ipc.RpcConnection(124): Using SIMPLE authentication for service=AdminService, sasl=false 2023-07-24 23:07:32,828 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:39714, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-07-24 23:07:32,828 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42121] regionserver.CompactSplit(310): Interrupting running compactions because user switched off compactions 2023-07-24 23:07:32,831 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-07-24 23:07:32,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:32,833 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:07:32,834 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithMergeRegion-1" procId is: 66 2023-07-24 23:07:32,834 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:07:32,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 23:07:32,837 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:32,837 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:32,838 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9 empty. 2023-07-24 23:07:32,838 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559 empty. 2023-07-24 23:07:32,838 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:32,838 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:32,838 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 23:07:32,853 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/.tabledesc/.tableinfo.0000000001 2023-07-24 23:07:32,854 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(7675): creating {ENCODED => c80c199d5006651c62ce0a70d8a92559, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:07:32,854 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(7675): creating {ENCODED => bb8803b0643cc809e185723bc5d085b9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9.', STARTKEY => '', ENDKEY => '2'}, tableDescriptor='testtb-testExportFileSystemStateWithMergeRegion-1', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:07:32,870 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:32,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1604): Closing c80c199d5006651c62ce0a70d8a92559, disabling compactions & flushes 2023-07-24 23:07:32,871 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:32,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:32,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. after waiting 0 ms 2023-07-24 23:07:32,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:32,871 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:32,871 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-1] regionserver.HRegion(1558): Region close journal for c80c199d5006651c62ce0a70d8a92559: 2023-07-24 23:07:32,874 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:32,874 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1604): Closing bb8803b0643cc809e185723bc5d085b9, disabling compactions & flushes 2023-07-24 23:07:32,874 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:32,874 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:32,874 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. after waiting 0 ms 2023-07-24 23:07:32,874 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:32,874 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:32,874 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithMergeRegion-1-pool-0] regionserver.HRegion(1558): Region close journal for bb8803b0643cc809e185723bc5d085b9: 2023-07-24 23:07:32,877 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:07:32,878 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240052877"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240052877"}]},"ts":"1690240052877"} 2023-07-24 23:07:32,878 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240052877"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240052877"}]},"ts":"1690240052877"} 2023-07-24 23:07:32,880 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:07:32,881 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:07:32,881 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240052881"}]},"ts":"1690240052881"} 2023-07-24 23:07:32,883 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLING in hbase:meta 2023-07-24 23:07:32,887 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:07:32,888 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:07:32,888 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:07:32,888 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:07:32,888 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:07:32,889 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb8803b0643cc809e185723bc5d085b9, ASSIGN}, {pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c80c199d5006651c62ce0a70d8a92559, ASSIGN}] 2023-07-24 23:07:32,896 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c80c199d5006651c62ce0a70d8a92559, ASSIGN 2023-07-24 23:07:32,897 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb8803b0643cc809e185723bc5d085b9, ASSIGN 2023-07-24 23:07:32,897 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=68, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c80c199d5006651c62ce0a70d8a92559, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34249,1690239969818; forceNewPlan=false, retain=false 2023-07-24 23:07:32,898 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb8803b0643cc809e185723bc5d085b9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39257,1690239969778; forceNewPlan=false, retain=false 2023-07-24 23:07:32,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 23:07:33,048 INFO [jenkins-hbase4:40271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:07:33,051 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c80c199d5006651c62ce0a70d8a92559, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:33,051 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bb8803b0643cc809e185723bc5d085b9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:33,051 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240053051"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240053051"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240053051"}]},"ts":"1690240053051"} 2023-07-24 23:07:33,051 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240053051"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240053051"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240053051"}]},"ts":"1690240053051"} 2023-07-24 23:07:33,054 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=69, ppid=68, state=RUNNABLE; OpenRegionProcedure c80c199d5006651c62ce0a70d8a92559, server=jenkins-hbase4.apache.org,34249,1690239969818}] 2023-07-24 23:07:33,055 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=70, ppid=67, state=RUNNABLE; OpenRegionProcedure bb8803b0643cc809e185723bc5d085b9, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:07:33,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 23:07:33,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:33,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bb8803b0643cc809e185723bc5d085b9, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9.', STARTKEY => '', ENDKEY => '2'} 2023-07-24 23:07:33,214 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:33,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c80c199d5006651c62ce0a70d8a92559, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559.', STARTKEY => '2', ENDKEY => ''} 2023-07-24 23:07:33,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. service=AccessControlService 2023-07-24 23:07:33,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:33,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:33,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:33,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:33,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:33,214 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. service=AccessControlService 2023-07-24 23:07:33,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:33,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:33,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:33,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:33,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:33,217 INFO [StoreOpener-bb8803b0643cc809e185723bc5d085b9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:33,221 DEBUG [StoreOpener-bb8803b0643cc809e185723bc5d085b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/cf 2023-07-24 23:07:33,221 DEBUG [StoreOpener-bb8803b0643cc809e185723bc5d085b9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/cf 2023-07-24 23:07:33,222 INFO [StoreOpener-bb8803b0643cc809e185723bc5d085b9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bb8803b0643cc809e185723bc5d085b9 columnFamilyName cf 2023-07-24 23:07:33,222 INFO [StoreOpener-bb8803b0643cc809e185723bc5d085b9-1] regionserver.HStore(310): Store=bb8803b0643cc809e185723bc5d085b9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:33,224 INFO [StoreOpener-c80c199d5006651c62ce0a70d8a92559-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:33,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:33,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:33,226 DEBUG [StoreOpener-c80c199d5006651c62ce0a70d8a92559-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/cf 2023-07-24 23:07:33,226 DEBUG [StoreOpener-c80c199d5006651c62ce0a70d8a92559-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/cf 2023-07-24 23:07:33,227 INFO [StoreOpener-c80c199d5006651c62ce0a70d8a92559-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c80c199d5006651c62ce0a70d8a92559 columnFamilyName cf 2023-07-24 23:07:33,227 INFO [StoreOpener-c80c199d5006651c62ce0a70d8a92559-1] regionserver.HStore(310): Store=c80c199d5006651c62ce0a70d8a92559/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:33,228 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:33,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:33,229 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:33,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:33,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:33,237 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bb8803b0643cc809e185723bc5d085b9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66705248, jitterRate=-0.006014347076416016}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:33,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:33,237 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bb8803b0643cc809e185723bc5d085b9: 2023-07-24 23:07:33,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c80c199d5006651c62ce0a70d8a92559; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58840829, jitterRate=-0.1232033222913742}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:33,238 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c80c199d5006651c62ce0a70d8a92559: 2023-07-24 23:07:33,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9., pid=70, masterSystemTime=1690240053206 2023-07-24 23:07:33,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559., pid=69, masterSystemTime=1690240053206 2023-07-24 23:07:33,242 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=bb8803b0643cc809e185723bc5d085b9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:33,242 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240053242"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240053242"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240053242"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240053242"}]},"ts":"1690240053242"} 2023-07-24 23:07:33,242 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:33,242 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:33,243 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=68 updating hbase:meta row=c80c199d5006651c62ce0a70d8a92559, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:33,243 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240053243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240053243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240053243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240053243"}]},"ts":"1690240053243"} 2023-07-24 23:07:33,244 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:33,244 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:33,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=70, resume processing ppid=67 2023-07-24 23:07:33,248 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=70, ppid=67, state=SUCCESS; OpenRegionProcedure bb8803b0643cc809e185723bc5d085b9, server=jenkins-hbase4.apache.org,39257,1690239969778 in 190 msec 2023-07-24 23:07:33,248 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=69, resume processing ppid=68 2023-07-24 23:07:33,249 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=69, ppid=68, state=SUCCESS; OpenRegionProcedure c80c199d5006651c62ce0a70d8a92559, server=jenkins-hbase4.apache.org,34249,1690239969818 in 192 msec 2023-07-24 23:07:33,250 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb8803b0643cc809e185723bc5d085b9, ASSIGN in 359 msec 2023-07-24 23:07:33,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=68, resume processing ppid=66 2023-07-24 23:07:33,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=68, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c80c199d5006651c62ce0a70d8a92559, ASSIGN in 360 msec 2023-07-24 23:07:33,254 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:07:33,254 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240053254"}]},"ts":"1690240053254"} 2023-07-24 23:07:33,255 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=ENABLED in hbase:meta 2023-07-24 23:07:33,258 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=66, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:07:33,259 DEBUG [PEWorker-4] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithMergeRegion-1 jenkins: RWXCA 2023-07-24 23:07:33,261 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 23:07:33,262 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:33,263 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:33,263 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:33,263 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:33,265 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:33,265 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:33,265 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:33,265 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:33,266 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:33,265 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:33,267 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=66, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 434 msec 2023-07-24 23:07:33,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:33,271 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF\x0AW\x0A\x07jenkins\x12L\x08\x03"H\x0A<\x0A\x07default\x121testtb-testExportFileSystemStateWithMergeRegion-1 \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:33,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=66 2023-07-24 23:07:33,440 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 66 completed 2023-07-24 23:07:33,473 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$2(1952): Client=jenkins//172.31.14.131 merge regions bb8803b0643cc809e185723bc5d085b9, c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:33,484 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb8803b0643cc809e185723bc5d085b9, c80c199d5006651c62ce0a70d8a92559], force=true 2023-07-24 23:07:33,489 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb8803b0643cc809e185723bc5d085b9, c80c199d5006651c62ce0a70d8a92559], force=true 2023-07-24 23:07:33,489 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb8803b0643cc809e185723bc5d085b9, c80c199d5006651c62ce0a70d8a92559], force=true 2023-07-24 23:07:33,489 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=71, state=RUNNABLE:MERGE_TABLE_REGIONS_PREPARE; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb8803b0643cc809e185723bc5d085b9, c80c199d5006651c62ce0a70d8a92559], force=true 2023-07-24 23:07:33,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:33,535 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb8803b0643cc809e185723bc5d085b9, UNASSIGN}, {pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c80c199d5006651c62ce0a70d8a92559, UNASSIGN}] 2023-07-24 23:07:33,537 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb8803b0643cc809e185723bc5d085b9, UNASSIGN 2023-07-24 23:07:33,538 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=73, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c80c199d5006651c62ce0a70d8a92559, UNASSIGN 2023-07-24 23:07:33,539 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bb8803b0643cc809e185723bc5d085b9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:33,539 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c80c199d5006651c62ce0a70d8a92559, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:33,539 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240053539"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240053539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240053539"}]},"ts":"1690240053539"} 2023-07-24 23:07:33,539 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240053539"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240053539"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240053539"}]},"ts":"1690240053539"} 2023-07-24 23:07:33,544 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=74, ppid=72, state=RUNNABLE; CloseRegionProcedure bb8803b0643cc809e185723bc5d085b9, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:07:33,550 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=75, ppid=73, state=RUNNABLE; CloseRegionProcedure c80c199d5006651c62ce0a70d8a92559, server=jenkins-hbase4.apache.org,34249,1690239969818}] 2023-07-24 23:07:33,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:33,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:33,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bb8803b0643cc809e185723bc5d085b9, disabling compactions & flushes 2023-07-24 23:07:33,705 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:33,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:33,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. after waiting 0 ms 2023-07-24 23:07:33,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:33,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing bb8803b0643cc809e185723bc5d085b9 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 23:07:33,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:33,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c80c199d5006651c62ce0a70d8a92559, disabling compactions & flushes 2023-07-24 23:07:33,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:33,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:33,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. after waiting 0 ms 2023-07-24 23:07:33,708 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:33,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c80c199d5006651c62ce0a70d8a92559 1/1 column families, dataSize=24 B heapSize=352 B 2023-07-24 23:07:33,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/.tmp/cf/3d8eaa2af09640deb51364e05772293f 2023-07-24 23:07:33,735 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=24 B at sequenceid=5 (bloomFilter=true), to=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/.tmp/cf/aae57167ed1441628c34b6115fcf1a29 2023-07-24 23:07:33,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/.tmp/cf/3d8eaa2af09640deb51364e05772293f as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/cf/3d8eaa2af09640deb51364e05772293f 2023-07-24 23:07:33,744 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/.tmp/cf/aae57167ed1441628c34b6115fcf1a29 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/cf/aae57167ed1441628c34b6115fcf1a29 2023-07-24 23:07:33,748 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/cf/3d8eaa2af09640deb51364e05772293f, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 23:07:33,749 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for bb8803b0643cc809e185723bc5d085b9 in 44ms, sequenceid=5, compaction requested=false 2023-07-24 23:07:33,750 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 23:07:33,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/cf/aae57167ed1441628c34b6115fcf1a29, entries=1, sequenceid=5, filesize=4.7 K 2023-07-24 23:07:33,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~24 B/24, heapSize ~336 B/336, currentSize=0 B/0 for c80c199d5006651c62ce0a70d8a92559 in 60ms, sequenceid=5, compaction requested=false 2023-07-24 23:07:33,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 23:07:33,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:33,793 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:33,795 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9. 2023-07-24 23:07:33,795 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bb8803b0643cc809e185723bc5d085b9: 2023-07-24 23:07:33,797 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:33,799 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=bb8803b0643cc809e185723bc5d085b9, regionState=CLOSED 2023-07-24 23:07:33,799 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240053799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240053799"}]},"ts":"1690240053799"} 2023-07-24 23:07:33,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=1 2023-07-24 23:07:33,800 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:33,803 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559. 2023-07-24 23:07:33,803 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c80c199d5006651c62ce0a70d8a92559: 2023-07-24 23:07:33,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=74, resume processing ppid=72 2023-07-24 23:07:33,805 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=74, ppid=72, state=SUCCESS; CloseRegionProcedure bb8803b0643cc809e185723bc5d085b9, server=jenkins-hbase4.apache.org,39257,1690239969778 in 258 msec 2023-07-24 23:07:33,806 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:33,815 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=73 updating hbase:meta row=c80c199d5006651c62ce0a70d8a92559, regionState=CLOSED 2023-07-24 23:07:33,815 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559.","families":{"info":[{"qualifier":"regioninfo","vlen":84,"tag":[],"timestamp":"1690240053815"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240053815"}]},"ts":"1690240053815"} 2023-07-24 23:07:33,816 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=bb8803b0643cc809e185723bc5d085b9, UNASSIGN in 281 msec 2023-07-24 23:07:33,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=75, resume processing ppid=73 2023-07-24 23:07:33,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=75, ppid=73, state=SUCCESS; CloseRegionProcedure c80c199d5006651c62ce0a70d8a92559, server=jenkins-hbase4.apache.org,34249,1690239969818 in 267 msec 2023-07-24 23:07:33,830 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=73, resume processing ppid=71 2023-07-24 23:07:33,831 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=73, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=c80c199d5006651c62ce0a70d8a92559, UNASSIGN in 292 msec 2023-07-24 23:07:34,052 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:07:34,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:34,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:34,712 DEBUG [PEWorker-5] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/recovered.edits/8.seqid, newMaxSeqId=8, maxSeqId=-1 2023-07-24 23:07:34,715 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052830.bb8803b0643cc809e185723bc5d085b9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:34,715 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,2,1690240052830.c80c199d5006651c62ce0a70d8a92559.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:34,716 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":7,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0000","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"merge0001","vlen":84,"tag":[],"timestamp":"9223372036854775807"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"9223372036854775807"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:34,788 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7327396e671cb8fef945ab456a2bbf91, ASSIGN}] 2023-07-24 23:07:34,791 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7327396e671cb8fef945ab456a2bbf91, ASSIGN 2023-07-24 23:07:34,792 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=76, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7327396e671cb8fef945ab456a2bbf91, ASSIGN; state=MERGED, location=jenkins-hbase4.apache.org,39257,1690239969778; forceNewPlan=false, retain=false 2023-07-24 23:07:34,943 INFO [jenkins-hbase4:40271] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2023-07-24 23:07:34,945 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7327396e671cb8fef945ab456a2bbf91, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:34,945 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690240054945"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240054945"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240054945"}]},"ts":"1690240054945"} 2023-07-24 23:07:34,947 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; OpenRegionProcedure 7327396e671cb8fef945ab456a2bbf91, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:07:35,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. 2023-07-24 23:07:35,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7327396e671cb8fef945ab456a2bbf91, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.', STARTKEY => '', ENDKEY => ''} 2023-07-24 23:07:35,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. service=AccessControlService 2023-07-24 23:07:35,104 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:35,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithMergeRegion-1 7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:35,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:35,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:35,104 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:35,105 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(950): Rewriting .regioninfo file at: hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/.regioninfo 2023-07-24 23:07:35,117 INFO [StoreOpener-7327396e671cb8fef945ab456a2bbf91-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:35,118 DEBUG [StoreOpener-7327396e671cb8fef945ab456a2bbf91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf 2023-07-24 23:07:35,118 DEBUG [StoreOpener-7327396e671cb8fef945ab456a2bbf91-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf 2023-07-24 23:07:35,118 INFO [StoreOpener-7327396e671cb8fef945ab456a2bbf91-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7327396e671cb8fef945ab456a2bbf91 columnFamilyName cf 2023-07-24 23:07:35,161 DEBUG [StoreOpener-7327396e671cb8fef945ab456a2bbf91-1] regionserver.HStore(539): loaded hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf/3d8eaa2af09640deb51364e05772293f.bb8803b0643cc809e185723bc5d085b9->hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/cf/3d8eaa2af09640deb51364e05772293f-top 2023-07-24 23:07:35,173 DEBUG [StoreOpener-7327396e671cb8fef945ab456a2bbf91-1] regionserver.HStore(539): loaded hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf/aae57167ed1441628c34b6115fcf1a29.c80c199d5006651c62ce0a70d8a92559->hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/cf/aae57167ed1441628c34b6115fcf1a29-top 2023-07-24 23:07:35,174 INFO [StoreOpener-7327396e671cb8fef945ab456a2bbf91-1] regionserver.HStore(310): Store=7327396e671cb8fef945ab456a2bbf91/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:35,175 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:35,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:35,193 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:35,194 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7327396e671cb8fef945ab456a2bbf91; next sequenceid=9; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62485568, jitterRate=-0.0688924789428711}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:35,194 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7327396e671cb8fef945ab456a2bbf91: 2023-07-24 23:07:35,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91., pid=77, masterSystemTime=1690240055100 2023-07-24 23:07:35,196 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(328): Ignoring compaction request for testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.,because compaction is disabled. 2023-07-24 23:07:35,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. 2023-07-24 23:07:35,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. 2023-07-24 23:07:35,198 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=7327396e671cb8fef945ab456a2bbf91, regionState=OPEN, openSeqNum=9, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,199 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690240055198"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240055198"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240055198"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240055198"}]},"ts":"1690240055198"} 2023-07-24 23:07:35,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=77, resume processing ppid=76 2023-07-24 23:07:35,204 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=77, ppid=76, state=SUCCESS; OpenRegionProcedure 7327396e671cb8fef945ab456a2bbf91, server=jenkins-hbase4.apache.org,39257,1690239969778 in 254 msec 2023-07-24 23:07:35,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=76, resume processing ppid=71 2023-07-24 23:07:35,206 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=76, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7327396e671cb8fef945ab456a2bbf91, ASSIGN in 416 msec 2023-07-24 23:07:35,210 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=71, state=SUCCESS; MergeTableRegionsProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, regions=[bb8803b0643cc809e185723bc5d085b9, c80c199d5006651c62ce0a70d8a92559], force=true in 1.7290 sec 2023-07-24 23:07:35,598 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-07-24 23:07:35,599 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: MERGE_REGIONS, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 71 completed 2023-07-24 23:07:35,600 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 23:07:35,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240055600 (current time:1690240055600). 2023-07-24 23:07:35,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:07:35,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x322954bd to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:35,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e40e8db, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:35,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:35,619 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35662, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:35,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x322954bd to 127.0.0.1:58202 2023-07-24 23:07:35,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:35,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x74086f44 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:35,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cfc51c4, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:35,648 DEBUG [hconnection-0x659366b0-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:35,652 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:35,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:35,661 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:35,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x74086f44 to 127.0.0.1:58202 2023-07-24 23:07:35,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:35,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithMergeRegion-1], kv [jenkins: RWXCA] 2023-07-24 23:07:35,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:07:35,664 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 23:07:35,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 23:07:35,668 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=78, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 23:07:35,668 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=78, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE; timeout=600000, timestamp=1690240655668 2023-07-24 23:07:35,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } 2023-07-24 23:07:35,668 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,673 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:07:35,673 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:07:35,675 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 23:07:35,690 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=78, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE 2023-07-24 23:07:35,697 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=78, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=EXCLUSIVE in 24 msec 2023-07-24 23:07:35,698 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=79, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 23:07:35,699 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=79, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED; timeout=600000, timestamp=1690240655699 2023-07-24 23:07:35,765 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,765 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' 2023-07-24 23:07:35,765 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:35,766 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' 2023-07-24 23:07:35,766 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1', kicking off acquire phase on members. 2023-07-24 23:07:35,767 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,767 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,768 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:35,768 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:35,768 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:35,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:35,768 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:35,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:35,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:35,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:35,769 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,769 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,769 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:07:35,769 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,770 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 23:07:35,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,770 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 23:07:35,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 23:07:35,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,770 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 23:07:35,771 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 220 2023-07-24 23:07:35,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,771 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 from table testtb-testExportFileSystemStateWithMergeRegion-1 type FLUSH 2023-07-24 23:07:35,773 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:35,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 23:07:35,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:35,775 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:07:35,776 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,777 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 23:07:35,777 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,777 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:35,777 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 23:07:35,777 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:35,779 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,778 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 23:07:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' with timeout 300000ms 2023-07-24 23:07:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 23:07:35,779 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 23:07:35,782 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,783 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,783 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 23:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 23:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'acquire' stage 2023-07-24 23:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally acquired 2023-07-24 23:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 23:07:35,789 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithMergeRegion-1) in zk 2023-07-24 23:07:35,793 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,793 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:35,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:35,793 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,793 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,793 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,795 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:35,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,796 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:35,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:35,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' on coordinator 2023-07-24 23:07:35,798 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5bfbd1f8[Count = 0] remaining members to acquire global barrier 2023-07-24 23:07:35,798 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' starting 'in-barrier' execution. 2023-07-24 23:07:35,798 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,800 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,800 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,800 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,800 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,800 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 23:07:35,800 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 23:07:35,800 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,800 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:07:35,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,800 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:07:35,801 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 23:07:35,801 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 23:07:35,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,801 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:07:35,801 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' received 'reached' from coordinator. 2023-07-24 23:07:35,802 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 23:07:35,802 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:35,802 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 23:07:35,803 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 23:07:35,803 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:35,803 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 23:07:35,838 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:35,839 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:35,839 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. 2023-07-24 23:07:35,839 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. started... 2023-07-24 23:07:35,841 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 7327396e671cb8fef945ab456a2bbf91: 2023-07-24 23:07:35,841 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.' region-info for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,841 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:35,841 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf/3d8eaa2af09640deb51364e05772293f.bb8803b0643cc809e185723bc5d085b9->hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/cf/3d8eaa2af09640deb51364e05772293f-top, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf/aae57167ed1441628c34b6115fcf1a29.c80c199d5006651c62ce0a70d8a92559->hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/cf/aae57167ed1441628c34b6115fcf1a29-top] hfiles 2023-07-24 23:07:35,841 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf/3d8eaa2af09640deb51364e05772293f.bb8803b0643cc809e185723bc5d085b9 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,842 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf/aae57167ed1441628c34b6115fcf1a29.c80c199d5006651c62ce0a70d8a92559 for snapshot=snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,870 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. completed. 2023-07-24 23:07:35,870 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. 2023-07-24 23:07:35,870 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:35,870 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:35,871 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,871 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' locally completed 2023-07-24 23:07:35,871 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:07:35,878 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' has notified controller of completion 2023-07-24 23:07:35,878 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,878 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:35,878 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' completed. 2023-07-24 23:07:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:35,878 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:35,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:35,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:35,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:35,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:07:35,884 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'snaptb0-testExportFileSystemStateWithMergeRegion-1', counting down latch. Waiting for 0 more 2023-07-24 23:07:35,884 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithMergeRegion-1' execution completed 2023-07-24 23:07:35,884 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:07:35,884 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:07:35,884 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,884 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithMergeRegion-1including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:07:35,886 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,887 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,886 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,886 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,887 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:35,887 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:35,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,887 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,887 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:35,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:35,888 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:35,888 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,889 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:35,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:35,890 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:35,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,892 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,893 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:35,893 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:35,894 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:35,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:35,896 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:35,896 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,896 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:35,896 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,897 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:35,897 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:35,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:35,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:35,896 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:35,897 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:35,897 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:35,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:35,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:35,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:35,898 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:35,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:35,899 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:35,899 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:35,899 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,899 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:35,899 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,899 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:35,899 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:35,899 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,899 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,899 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:35,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:35,900 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:35,900 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:35,900 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,901 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:35,902 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:35,902 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(398): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Unable to get data of znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithMergeRegion-1 because node does not exist (not an error) 2023-07-24 23:07:35,952 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:35,975 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:35,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 23:07:35,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:35,978 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:07:36,051 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed 2023-07-24 23:07:36,051 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:36,057 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:36,057 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithMergeRegion-1 at 1690240055669Consolidate snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690240055900 (+231 ms)Loading Region manifests for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690240055900Writing data manifest for snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690240055908 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 at 1690240055943 (+35 ms)Snapshot snaptb0-testExportFileSystemStateWithMergeRegion-1 of table testtb-testExportFileSystemStateWithMergeRegion-1 completed at 1690240056051 (+108 ms) 2023-07-24 23:07:36,064 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=79, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED 2023-07-24 23:07:36,069 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=79, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithMergeRegion-1, type=SHARED in 392 msec 2023-07-24 23:07:36,278 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:36,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 } is done 2023-07-24 23:07:36,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithMergeRegion-1 table=testtb-testExportFileSystemStateWithMergeRegion-1 type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:07:36,281 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240056281 2023-07-24 23:07:36,281 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33513, tgtDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240056281, rawTgtDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240056281, srcFsUri=hdfs://localhost:33513, srcDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:07:36,310 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:07:36,310 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1976754006_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240056281, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240056281/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:36,310 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316, snapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1. 2023-07-24 23:07:36,339 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240056281/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:36,422 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,424 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,424 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,425 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,425 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,426 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,426 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,517 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop-5022461683709452522.jar 2023-07-24 23:07:36,517 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,518 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,518 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,519 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,519 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,519 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:36,520 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:07:36,520 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:07:36,521 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:07:36,521 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:07:36,521 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:07:36,522 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:07:36,523 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:07:36,523 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:07:36,524 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:07:36,524 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:07:36,525 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:36,525 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:36,525 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:36,525 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:36,526 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:36,526 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:36,527 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:38,685 WARN [Listener at jenkins-hbase4.apache.org/36985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:07:38,688 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithMergeRegion-1' hfile list 2023-07-24 23:07:38,690 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(671): export split=0 size=9.5 K 2023-07-24 23:07:38,802 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:38,802 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:39,296 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:07:39,435 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0005_000001 (auth:SIMPLE) 2023-07-24 23:07:45,577 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0005_000001 (auth:SIMPLE) 2023-07-24 23:07:47,921 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0005_000001 (auth:SIMPLE) 2023-07-24 23:07:51,207 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0005_000001 (auth:SIMPLE) 2023-07-24 23:07:53,033 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:07:53,049 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:07:53,067 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,067 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:07:53,067 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:07:53,068 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,070 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 23:07:53,070 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 23:07:53,070 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240056281/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240056281/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,071 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240056281/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/.snapshotinfo 2023-07-24 23:07:53,071 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240056281/.hbase-snapshot/snaptb0-testExportFileSystemStateWithMergeRegion-1/data.manifest 2023-07-24 23:07:53,078 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,078 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=80, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 23:07:53,086 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240073085"}]},"ts":"1690240073085"} 2023-07-24 23:07:53,087 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLING in hbase:meta 2023-07-24 23:07:53,090 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLING 2023-07-24 23:07:53,091 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7327396e671cb8fef945ab456a2bbf91, UNASSIGN}] 2023-07-24 23:07:53,101 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=80, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7327396e671cb8fef945ab456a2bbf91, UNASSIGN 2023-07-24 23:07:53,103 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7327396e671cb8fef945ab456a2bbf91, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:53,103 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690240073102"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240073102"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240073102"}]},"ts":"1690240073102"} 2023-07-24 23:07:53,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=82, ppid=81, state=RUNNABLE; CloseRegionProcedure 7327396e671cb8fef945ab456a2bbf91, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:07:53,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 23:07:53,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:53,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7327396e671cb8fef945ab456a2bbf91, disabling compactions & flushes 2023-07-24 23:07:53,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. 2023-07-24 23:07:53,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. 2023-07-24 23:07:53,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. after waiting 0 ms 2023-07-24 23:07:53,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. 2023-07-24 23:07:53,280 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/recovered.edits/12.seqid, newMaxSeqId=12, maxSeqId=8 2023-07-24 23:07:53,281 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:53,282 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91. 2023-07-24 23:07:53,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7327396e671cb8fef945ab456a2bbf91: 2023-07-24 23:07:53,284 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:53,284 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=7327396e671cb8fef945ab456a2bbf91, regionState=CLOSED 2023-07-24 23:07:53,284 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.","families":{"info":[{"qualifier":"regioninfo","vlen":83,"tag":[],"timestamp":"1690240073284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240073284"}]},"ts":"1690240073284"} 2023-07-24 23:07:53,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=82, resume processing ppid=81 2023-07-24 23:07:53,290 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=82, ppid=81, state=SUCCESS; CloseRegionProcedure 7327396e671cb8fef945ab456a2bbf91, server=jenkins-hbase4.apache.org,39257,1690239969778 in 183 msec 2023-07-24 23:07:53,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=81, resume processing ppid=80 2023-07-24 23:07:53,293 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=81, ppid=80, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1, region=7327396e671cb8fef945ab456a2bbf91, UNASSIGN in 199 msec 2023-07-24 23:07:53,294 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240073294"}]},"ts":"1690240073294"} 2023-07-24 23:07:53,295 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion-1, state=DISABLED in hbase:meta 2023-07-24 23:07:53,297 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion-1 to state=DISABLED 2023-07-24 23:07:53,301 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=80, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 220 msec 2023-07-24 23:07:53,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=80 2023-07-24 23:07:53,389 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 80 completed 2023-07-24 23:07:53,390 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,394 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=83, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,395 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=83, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,396 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,403 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,403 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,403 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,403 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,404 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 23:07:53,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 23:07:53,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 23:07:53,405 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion-1 with data PBUF 2023-07-24 23:07:53,406 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,406 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,406 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:53,406 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,406 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:53,406 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,406 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:53,406 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:53,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:53,407 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:53,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:53,408 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF\x0AU\x0A\x07jenkins\x12J\x08\x03"F\x0A:\x0A\x07default\x12/testtb-testExportFileSystemStateWithMergeRegion \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:53,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 23:07:53,416 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:53,418 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:53,419 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:53,426 DEBUG [HFileArchiver-19] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/recovered.edits] 2023-07-24 23:07:53,426 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/recovered.edits] 2023-07-24 23:07:53,427 DEBUG [HFileArchiver-20] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/recovered.edits] 2023-07-24 23:07:53,435 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/cf/aae57167ed1441628c34b6115fcf1a29 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/cf/aae57167ed1441628c34b6115fcf1a29 2023-07-24 23:07:53,439 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf/3d8eaa2af09640deb51364e05772293f.bb8803b0643cc809e185723bc5d085b9 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf/3d8eaa2af09640deb51364e05772293f.bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:53,439 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/recovered.edits/8.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559/recovered.edits/8.seqid 2023-07-24 23:07:53,447 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:53,450 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/cf/3d8eaa2af09640deb51364e05772293f to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/cf/3d8eaa2af09640deb51364e05772293f 2023-07-24 23:07:53,453 DEBUG [HFileArchiver-20] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/recovered.edits/8.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9/recovered.edits/8.seqid 2023-07-24 23:07:53,454 DEBUG [HFileArchiver-20] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/bb8803b0643cc809e185723bc5d085b9 2023-07-24 23:07:53,457 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf/aae57167ed1441628c34b6115fcf1a29.c80c199d5006651c62ce0a70d8a92559 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/cf/aae57167ed1441628c34b6115fcf1a29.c80c199d5006651c62ce0a70d8a92559 2023-07-24 23:07:53,466 DEBUG [HFileArchiver-19] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/recovered.edits/12.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91/recovered.edits/12.seqid 2023-07-24 23:07:53,466 DEBUG [HFileArchiver-19] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion-1/7327396e671cb8fef945ab456a2bbf91 2023-07-24 23:07:53,466 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion-1 regions 2023-07-24 23:07:53,469 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=83, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,472 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testtb-testExportFileSystemStateWithMergeRegion-1 from hbase:meta 2023-07-24 23:07:53,474 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' descriptor. 2023-07-24 23:07:53,475 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=83, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,475 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion-1' from region states. 2023-07-24 23:07:53,475 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240073475"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:53,480 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-07-24 23:07:53,480 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7327396e671cb8fef945ab456a2bbf91, NAME => 'testtb-testExportFileSystemStateWithMergeRegion-1,,1690240052831.7327396e671cb8fef945ab456a2bbf91.', STARTKEY => '', ENDKEY => ''}] 2023-07-24 23:07:53,480 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion-1' as deleted. 2023-07-24 23:07:53,480 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion-1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240073480"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:53,484 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion-1 state from META 2023-07-24 23:07:53,486 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=83, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=83, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion-1 in 96 msec 2023-07-24 23:07:53,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=83 2023-07-24 23:07:53,510 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion-1, procId: 83 completed 2023-07-24 23:07:53,510 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,511 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=84, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 23:07:53,516 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240073516"}]},"ts":"1690240073516"} 2023-07-24 23:07:53,518 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLING in hbase:meta 2023-07-24 23:07:53,520 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLING 2023-07-24 23:07:53,522 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b1dfa0af010020aa404362650b7fd3, UNASSIGN}, {pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=002333a312ee3328d37909db42818f38, UNASSIGN}] 2023-07-24 23:07:53,524 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=85, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b1dfa0af010020aa404362650b7fd3, UNASSIGN 2023-07-24 23:07:53,526 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=86, ppid=84, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=002333a312ee3328d37909db42818f38, UNASSIGN 2023-07-24 23:07:53,527 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=20b1dfa0af010020aa404362650b7fd3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:53,527 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=002333a312ee3328d37909db42818f38, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:53,527 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240073527"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240073527"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240073527"}]},"ts":"1690240073527"} 2023-07-24 23:07:53,527 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240073527"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240073527"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240073527"}]},"ts":"1690240073527"} 2023-07-24 23:07:53,529 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=87, ppid=85, state=RUNNABLE; CloseRegionProcedure 20b1dfa0af010020aa404362650b7fd3, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:07:53,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=88, ppid=86, state=RUNNABLE; CloseRegionProcedure 002333a312ee3328d37909db42818f38, server=jenkins-hbase4.apache.org,42121,1690239969723}] 2023-07-24 23:07:53,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 23:07:53,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:53,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 20b1dfa0af010020aa404362650b7fd3, disabling compactions & flushes 2023-07-24 23:07:53,681 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:53,681 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:53,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. after waiting 0 ms 2023-07-24 23:07:53,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:53,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 002333a312ee3328d37909db42818f38 2023-07-24 23:07:53,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 002333a312ee3328d37909db42818f38, disabling compactions & flushes 2023-07-24 23:07:53,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:53,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:53,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. after waiting 0 ms 2023-07-24 23:07:53,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:53,702 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:07:53,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:53,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3. 2023-07-24 23:07:53,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 20b1dfa0af010020aa404362650b7fd3: 2023-07-24 23:07:53,712 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:53,712 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=85 updating hbase:meta row=20b1dfa0af010020aa404362650b7fd3, regionState=CLOSED 2023-07-24 23:07:53,712 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240073712"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240073712"}]},"ts":"1690240073712"} 2023-07-24 23:07:53,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=87, resume processing ppid=85 2023-07-24 23:07:53,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=87, ppid=85, state=SUCCESS; CloseRegionProcedure 20b1dfa0af010020aa404362650b7fd3, server=jenkins-hbase4.apache.org,39257,1690239969778 in 184 msec 2023-07-24 23:07:53,716 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=85, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=20b1dfa0af010020aa404362650b7fd3, UNASSIGN in 193 msec 2023-07-24 23:07:53,739 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:07:53,740 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:07:53,741 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38. 2023-07-24 23:07:53,741 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 002333a312ee3328d37909db42818f38: 2023-07-24 23:07:53,743 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 002333a312ee3328d37909db42818f38 2023-07-24 23:07:53,744 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=86 updating hbase:meta row=002333a312ee3328d37909db42818f38, regionState=CLOSED 2023-07-24 23:07:53,744 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.","families":{"info":[{"qualifier":"regioninfo","vlen":82,"tag":[],"timestamp":"1690240073744"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240073744"}]},"ts":"1690240073744"} 2023-07-24 23:07:53,747 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=88, resume processing ppid=86 2023-07-24 23:07:53,748 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=88, ppid=86, state=SUCCESS; CloseRegionProcedure 002333a312ee3328d37909db42818f38, server=jenkins-hbase4.apache.org,42121,1690239969723 in 216 msec 2023-07-24 23:07:53,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=86, resume processing ppid=84 2023-07-24 23:07:53,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=86, ppid=84, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithMergeRegion, region=002333a312ee3328d37909db42818f38, UNASSIGN in 226 msec 2023-07-24 23:07:53,750 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240073750"}]},"ts":"1690240073750"} 2023-07-24 23:07:53,753 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithMergeRegion, state=DISABLED in hbase:meta 2023-07-24 23:07:53,755 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithMergeRegion to state=DISABLED 2023-07-24 23:07:53,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=84, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 252 msec 2023-07-24 23:07:53,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=84 2023-07-24 23:07:53,818 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 84 completed 2023-07-24 23:07:53,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,825 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=89, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,826 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=89, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,827 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,831 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,831 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,831 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 23:07:53,831 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,831 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data PBUF 2023-07-24 23:07:53,832 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:53,832 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38 2023-07-24 23:07:53,832 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:53,832 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-24 23:07:53,832 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:07:53,832 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithMergeRegion with data null 2023-07-24 23:07:53,832 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:07:53,832 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:53,832 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,832 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:53,833 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,833 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:53,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 23:07:53,834 DEBUG [HFileArchiver-13] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/recovered.edits] 2023-07-24 23:07:53,835 DEBUG [HFileArchiver-15] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/recovered.edits] 2023-07-24 23:07:53,839 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/cf/b591f8721cfc4a2aae894e303fcec61d to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/cf/b591f8721cfc4a2aae894e303fcec61d 2023-07-24 23:07:53,840 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/cf/0432e5a79cb240889cc3406d74d9ed99 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/cf/0432e5a79cb240889cc3406d74d9ed99 2023-07-24 23:07:53,843 DEBUG [HFileArchiver-13] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3/recovered.edits/9.seqid 2023-07-24 23:07:53,843 DEBUG [HFileArchiver-13] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/20b1dfa0af010020aa404362650b7fd3 2023-07-24 23:07:53,844 DEBUG [HFileArchiver-15] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38/recovered.edits/9.seqid 2023-07-24 23:07:53,844 DEBUG [HFileArchiver-15] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithMergeRegion/002333a312ee3328d37909db42818f38 2023-07-24 23:07:53,844 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithMergeRegion regions 2023-07-24 23:07:53,845 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 23:07:53,846 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf] 2023-07-24 23:07:53,856 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724903d922ae5d344a7977374c0c30d2848 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/c4ca4238a0b923820dcc509a6f75849b20230724903d922ae5d344a7977374c0c30d2848 2023-07-24 23:07:53,857 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724f5cffa14cbd74daba3cbf834eb4a9114 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c/cf/d41d8cd98f00b204e9800998ecf8427e20230724f5cffa14cbd74daba3cbf834eb4a9114 2023-07-24 23:07:53,858 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithMergeRegion/aaca68e56e63a701f5c1ec9dc2f0511c 2023-07-24 23:07:53,861 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=89, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,863 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithMergeRegion from hbase:meta 2023-07-24 23:07:53,865 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithMergeRegion' descriptor. 2023-07-24 23:07:53,866 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=89, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,866 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithMergeRegion' from region states. 2023-07-24 23:07:53,866 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240073866"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:53,866 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240073866"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:53,868 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:07:53,868 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 20b1dfa0af010020aa404362650b7fd3, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,,1690240048773.20b1dfa0af010020aa404362650b7fd3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 002333a312ee3328d37909db42818f38, NAME => 'testtb-testExportFileSystemStateWithMergeRegion,1,1690240048773.002333a312ee3328d37909db42818f38.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:07:53,868 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithMergeRegion' as deleted. 2023-07-24 23:07:53,868 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithMergeRegion","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240073868"}]},"ts":"9223372036854775807"} 2023-07-24 23:07:53,875 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithMergeRegion state from META 2023-07-24 23:07:53,877 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=89, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,878 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=89, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithMergeRegion in 58 msec 2023-07-24 23:07:53,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=89 2023-07-24 23:07:53,935 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithMergeRegion, procId: 89 completed 2023-07-24 23:07:53,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 23:07:53,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,952 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion" 2023-07-24 23:07:53,955 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion 2023-07-24 23:07:53,956 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithMergeRegion-1" 2023-07-24 23:07:53,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithMergeRegion-1 2023-07-24 23:07:53,999 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithMergeRegion Thread=758 (was 746) Potentially hanging thread: Thread-4110 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-6 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-38 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-18 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-35 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-5 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1917883065_1 at /127.0.0.1:48076 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-37 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-15 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:34932 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-17 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:37063 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-36 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-16 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-33 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-34 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #7 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #8 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1917883065_1 at /127.0.0.1:32830 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-6-7 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:48088 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-19 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:32852 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-20 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 899) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=548 (was 446) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 182), AvailableMemoryMB=5237 (was 5416) 2023-07-24 23:07:54,000 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-24 23:07:54,031 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=758, OpenFileDescriptor=906, MaxFileDescriptor=60000, SystemLoadAverage=548, ProcessCount=180, AvailableMemoryMB=5231 2023-07-24 23:07:54,031 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=758 is superior to 500 2023-07-24 23:07:54,033 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 23:07:54,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:07:54,037 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:07:54,038 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testEmptyExportFileSystemState" procId is: 90 2023-07-24 23:07:54,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 23:07:54,039 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:07:54,043 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:07:54,043 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:07:54,044 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe empty. 2023-07-24 23:07:54,045 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1 empty. 2023-07-24 23:07:54,045 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:07:54,045 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:07:54,045 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 23:07:54,089 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/.tabledesc/.tableinfo.0000000001 2023-07-24 23:07:54,094 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(7675): creating {ENCODED => 4b3a4aef5b4eeab83a105c3c9b8d61c1, NAME => 'testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:07:54,094 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(7675): creating {ENCODED => 40459561cdc0c6c7744ccc3bb654e3fe, NAME => 'testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testEmptyExportFileSystemState', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:07:54,119 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:54,119 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1604): Closing 40459561cdc0c6c7744ccc3bb654e3fe, disabling compactions & flushes 2023-07-24 23:07:54,119 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:54,120 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:54,120 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. after waiting 0 ms 2023-07-24 23:07:54,120 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:54,120 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:54,120 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-0] regionserver.HRegion(1558): Region close journal for 40459561cdc0c6c7744ccc3bb654e3fe: 2023-07-24 23:07:54,140 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:54,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 23:07:54,140 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1604): Closing 4b3a4aef5b4eeab83a105c3c9b8d61c1, disabling compactions & flushes 2023-07-24 23:07:54,141 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:54,141 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:54,141 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. after waiting 0 ms 2023-07-24 23:07:54,141 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:54,141 INFO [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:54,141 DEBUG [RegionOpenAndInit-testtb-testEmptyExportFileSystemState-pool-1] regionserver.HRegion(1558): Region close journal for 4b3a4aef5b4eeab83a105c3c9b8d61c1: 2023-07-24 23:07:54,144 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:07:54,145 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240074145"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240074145"}]},"ts":"1690240074145"} 2023-07-24 23:07:54,145 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240074145"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240074145"}]},"ts":"1690240074145"} 2023-07-24 23:07:54,154 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:07:54,157 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:07:54,157 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240074157"}]},"ts":"1690240074157"} 2023-07-24 23:07:54,159 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLING in hbase:meta 2023-07-24 23:07:54,163 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:07:54,164 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:07:54,164 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:07:54,164 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:07:54,164 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:07:54,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40459561cdc0c6c7744ccc3bb654e3fe, ASSIGN}, {pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b3a4aef5b4eeab83a105c3c9b8d61c1, ASSIGN}] 2023-07-24 23:07:54,168 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40459561cdc0c6c7744ccc3bb654e3fe, ASSIGN 2023-07-24 23:07:54,168 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b3a4aef5b4eeab83a105c3c9b8d61c1, ASSIGN 2023-07-24 23:07:54,169 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=91, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40459561cdc0c6c7744ccc3bb654e3fe, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34249,1690239969818; forceNewPlan=false, retain=false 2023-07-24 23:07:54,169 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=92, ppid=90, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b3a4aef5b4eeab83a105c3c9b8d61c1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39257,1690239969778; forceNewPlan=false, retain=false 2023-07-24 23:07:54,319 INFO [jenkins-hbase4:40271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:07:54,323 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=40459561cdc0c6c7744ccc3bb654e3fe, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:54,323 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4b3a4aef5b4eeab83a105c3c9b8d61c1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:54,323 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240074323"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240074323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240074323"}]},"ts":"1690240074323"} 2023-07-24 23:07:54,323 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240074323"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240074323"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240074323"}]},"ts":"1690240074323"} 2023-07-24 23:07:54,336 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=93, ppid=91, state=RUNNABLE; OpenRegionProcedure 40459561cdc0c6c7744ccc3bb654e3fe, server=jenkins-hbase4.apache.org,34249,1690239969818}] 2023-07-24 23:07:54,340 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=94, ppid=92, state=RUNNABLE; OpenRegionProcedure 4b3a4aef5b4eeab83a105c3c9b8d61c1, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:07:54,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 23:07:54,498 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4b3a4aef5b4eeab83a105c3c9b8d61c1, NAME => 'testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:07:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. service=AccessControlService 2023-07-24 23:07:54,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:07:54,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 40459561cdc0c6c7744ccc3bb654e3fe, NAME => 'testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:07:54,499 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:07:54,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:07:54,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. service=AccessControlService 2023-07-24 23:07:54,500 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:07:54,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testEmptyExportFileSystemState 40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:07:54,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:07:54,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:07:54,500 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:07:54,501 INFO [StoreOpener-40459561cdc0c6c7744ccc3bb654e3fe-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:07:54,502 INFO [StoreOpener-4b3a4aef5b4eeab83a105c3c9b8d61c1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:07:54,503 DEBUG [StoreOpener-40459561cdc0c6c7744ccc3bb654e3fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/cf 2023-07-24 23:07:54,503 DEBUG [StoreOpener-40459561cdc0c6c7744ccc3bb654e3fe-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/cf 2023-07-24 23:07:54,504 INFO [StoreOpener-40459561cdc0c6c7744ccc3bb654e3fe-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 40459561cdc0c6c7744ccc3bb654e3fe columnFamilyName cf 2023-07-24 23:07:54,505 DEBUG [StoreOpener-4b3a4aef5b4eeab83a105c3c9b8d61c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/cf 2023-07-24 23:07:54,505 DEBUG [StoreOpener-4b3a4aef5b4eeab83a105c3c9b8d61c1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/cf 2023-07-24 23:07:54,506 INFO [StoreOpener-4b3a4aef5b4eeab83a105c3c9b8d61c1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4b3a4aef5b4eeab83a105c3c9b8d61c1 columnFamilyName cf 2023-07-24 23:07:54,506 INFO [StoreOpener-40459561cdc0c6c7744ccc3bb654e3fe-1] regionserver.HStore(310): Store=40459561cdc0c6c7744ccc3bb654e3fe/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:54,507 INFO [StoreOpener-4b3a4aef5b4eeab83a105c3c9b8d61c1-1] regionserver.HStore(310): Store=4b3a4aef5b4eeab83a105c3c9b8d61c1/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:07:54,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:07:54,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:07:54,508 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:07:54,509 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:07:54,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:07:54,513 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:07:54,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:54,517 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 40459561cdc0c6c7744ccc3bb654e3fe; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64354198, jitterRate=-0.04104772210121155}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:54,517 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 40459561cdc0c6c7744ccc3bb654e3fe: 2023-07-24 23:07:54,518 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:07:54,519 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4b3a4aef5b4eeab83a105c3c9b8d61c1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70908645, jitterRate=0.05662114918231964}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:07:54,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4b3a4aef5b4eeab83a105c3c9b8d61c1: 2023-07-24 23:07:54,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1., pid=94, masterSystemTime=1690240074494 2023-07-24 23:07:54,523 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe., pid=93, masterSystemTime=1690240074489 2023-07-24 23:07:54,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:54,525 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:54,526 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=92 updating hbase:meta row=4b3a4aef5b4eeab83a105c3c9b8d61c1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:54,526 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:54,526 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:54,526 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240074525"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240074525"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240074525"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240074525"}]},"ts":"1690240074525"} 2023-07-24 23:07:54,527 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=40459561cdc0c6c7744ccc3bb654e3fe, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:54,527 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240074527"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240074527"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240074527"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240074527"}]},"ts":"1690240074527"} 2023-07-24 23:07:54,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=94, resume processing ppid=92 2023-07-24 23:07:54,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=94, ppid=92, state=SUCCESS; OpenRegionProcedure 4b3a4aef5b4eeab83a105c3c9b8d61c1, server=jenkins-hbase4.apache.org,39257,1690239969778 in 188 msec 2023-07-24 23:07:54,532 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=93, resume processing ppid=91 2023-07-24 23:07:54,532 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=93, ppid=91, state=SUCCESS; OpenRegionProcedure 40459561cdc0c6c7744ccc3bb654e3fe, server=jenkins-hbase4.apache.org,34249,1690239969818 in 193 msec 2023-07-24 23:07:54,534 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=92, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b3a4aef5b4eeab83a105c3c9b8d61c1, ASSIGN in 368 msec 2023-07-24 23:07:54,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=91, resume processing ppid=90 2023-07-24 23:07:54,535 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=91, ppid=90, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40459561cdc0c6c7744ccc3bb654e3fe, ASSIGN in 369 msec 2023-07-24 23:07:54,536 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:07:54,536 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240074536"}]},"ts":"1690240074536"} 2023-07-24 23:07:54,538 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=ENABLED in hbase:meta 2023-07-24 23:07:54,541 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=90, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testEmptyExportFileSystemState execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:07:54,541 DEBUG [PEWorker-2] access.PermissionStorage(175): Writing permission with rowKey testtb-testEmptyExportFileSystemState jenkins: RWXCA 2023-07-24 23:07:54,543 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:07:54,544 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:54,544 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:54,545 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:54,545 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:07:54,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:54,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:54,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:54,547 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF\x0AK\x0A\x07jenkins\x12@\x08\x03"<\x0A0\x0A\x07default\x12%testtb-testEmptyExportFileSystemState \x00 \x01 \x02 \x03 \x04 2023-07-24 23:07:54,551 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=90, state=SUCCESS; CreateTableProcedure table=testtb-testEmptyExportFileSystemState in 514 msec 2023-07-24 23:07:54,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=90 2023-07-24 23:07:54,643 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 90 completed 2023-07-24 23:07:54,646 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 23:07:54,646 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:54,648 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:07:54,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:54,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240074685 (current time:1690240074685). 2023-07-24 23:07:54,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:07:54,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x0a883621 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:54,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@34f87764, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:54,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:54,701 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:54,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a883621 to 127.0.0.1:58202 2023-07-24 23:07:54,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:54,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x6d34c920 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:54,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2646c399, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:54,729 DEBUG [hconnection-0x5172d362-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:54,733 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33886, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:54,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:54,740 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:54,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d34c920 to 127.0.0.1:58202 2023-07-24 23:07:54,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:54,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:07:54,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:07:54,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:54,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:54,753 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:54,754 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690240674754 2023-07-24 23:07:54,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:54,754 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 23:07:54,756 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:07:54,756 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:07:54,762 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:54,764 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:54,771 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 14 msec 2023-07-24 23:07:54,776 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=96, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:54,776 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=96, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690240674776 2023-07-24 23:07:54,818 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,819 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState' 2023-07-24 23:07:54,819 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:54,820 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 23:07:54,820 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 23:07:54,821 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,821 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,827 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:54,827 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:54,827 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:54,827 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:54,827 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:54,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:54,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:54,828 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:54,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:54,828 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:54,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,828 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,828 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:54,828 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:54,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,829 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,828 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 23:07:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 23:07:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,830 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 189 2023-07-24 23:07:54,830 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,830 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:54,830 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:54,830 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:07:54,830 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:54,831 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,831 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:54,831 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:54,835 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,855 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:54,855 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:54,857 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:54,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,857 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:54,840 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:54,857 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:54,857 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:54,857 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:54,857 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:54,857 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:54,860 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:54,859 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:54,860 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:54,860 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (emptySnaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:54,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:54,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:54,861 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:07:54,862 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,863 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:54,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:54,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:54,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:54,863 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,863 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,863 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,863 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:54,863 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:54,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:54,864 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,864 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:54,864 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,864 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:54,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:54,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:54,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:54,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:54,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:54,868 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 23:07:54,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40737a7b[Count = 1] remaining members to acquire global barrier 2023-07-24 23:07:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:54,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:54,870 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:54,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:54,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:54,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:54,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'emptySnaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 23:07:54,874 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40737a7b[Count = 0] remaining members to acquire global barrier 2023-07-24 23:07:54,874 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 23:07:54,874 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,876 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,876 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,876 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,876 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:54,877 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:54,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:54,877 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:54,877 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:07:54,877 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:07:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:54,880 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:54,882 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:54,899 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:54,898 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:54,900 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:54,898 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:54,900 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. started... 2023-07-24 23:07:54,900 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. started... 2023-07-24 23:07:54,902 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b3a4aef5b4eeab83a105c3c9b8d61c1: 2023-07-24 23:07:54,902 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,902 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:54,902 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:07:54,903 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 40459561cdc0c6c7744ccc3bb654e3fe: 2023-07-24 23:07:54,903 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:54,903 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:54,903 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:07:55,000 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. completed. 2023-07-24 23:07:55,000 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:55,000 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:55,000 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:55,000 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,000 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:55,000 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:07:55,002 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:55,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:55,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:55,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,004 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:55,005 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,006 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,007 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:55,007 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:55,007 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:55,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34249,1690239969818': 2023-07-24 23:07:55,009 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 23:07:55,011 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. completed. 2023-07-24 23:07:55,012 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:55,012 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:55,012 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:55,012 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,012 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:55,012 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:07:55,013 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:55,014 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,014 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:55,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:55,014 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:55,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,018 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:07:55,020 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'emptySnaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 23:07:55,020 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 23:07:55,020 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:07:55,020 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:07:55,020 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,020 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:07:55,022 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,022 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,022 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,022 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:55,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,022 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:55,022 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:55,022 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,022 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:55,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:55,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,023 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:55,024 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,024 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,024 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:55,025 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:55,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,027 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,028 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,028 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,033 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:55,033 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:55,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:55,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:55,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:55,033 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:55,033 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,033 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:55,033 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:55,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,033 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:55,033 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:55,035 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:55,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:55,033 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,033 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 23:07:55,033 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:55,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:55,033 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:55,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,036 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:07:55,036 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:55,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:55,036 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,036 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,036 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,037 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,037 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,037 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,037 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,037 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 23:07:55,061 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:55,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:55,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:55,065 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:07:55,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,117 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,180 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 23:07:55,180 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,181 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,181 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690240074754Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690240075066 (+312 ms)Consolidate snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690240075066Loading Region manifests for emptySnaptb0-testEmptyExportFileSystemState at 1690240075066Writing data manifest for emptySnaptb0-testEmptyExportFileSystemState at 1690240075095 (+29 ms)Verifying snapshot: emptySnaptb0-testEmptyExportFileSystemState at 1690240075109 (+14 ms)Snapshot emptySnaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690240075180 (+71 ms) 2023-07-24 23:07:55,185 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=96, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:55,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=96, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 429 msec 2023-07-24 23:07:55,366 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:55,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:55,367 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:07:55,370 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34249] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:07:55,371 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39257] regionserver.HRegion(8805): writing data to region testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:07:55,377 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testEmptyExportFileSystemState 2023-07-24 23:07:55,377 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:55,377 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:07:55,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:55,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240075397 (current time:1690240075397). 2023-07-24 23:07:55,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:07:55,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x0fd5ba67 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:55,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@48fb813c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:55,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:55,426 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33892, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:55,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0fd5ba67 to 127.0.0.1:58202 2023-07-24 23:07:55,427 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:55,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x36c0194e to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:07:55,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@14e49b73, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:07:55,543 DEBUG [hconnection-0x820ab2-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:55,544 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33900, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:55,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:07:55,563 INFO [RS-EventLoopGroup-5-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32958, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:07:55,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36c0194e to 127.0.0.1:58202 2023-07-24 23:07:55,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:07:55,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testEmptyExportFileSystemState], kv [jenkins: RWXCA] 2023-07-24 23:07:55,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:07:55,573 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:55,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:55,579 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=97, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:55,580 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=97, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE; timeout=600000, timestamp=1690240675580 2023-07-24 23:07:55,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } 2023-07-24 23:07:55,581 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState 2023-07-24 23:07:55,581 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:07:55,581 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:07:55,585 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=97, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE 2023-07-24 23:07:55,585 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:55,587 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=97, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=EXCLUSIVE in 10 msec 2023-07-24 23:07:55,591 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=98, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:55,593 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=98, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED; timeout=600000, timestamp=1690240675593 2023-07-24 23:07:55,643 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,643 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testEmptyExportFileSystemState' 2023-07-24 23:07:55,643 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:55,645 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' 2023-07-24 23:07:55,645 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testEmptyExportFileSystemState', kicking off acquire phase on members. 2023-07-24 23:07:55,645 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,645 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,647 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:55,647 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:55,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:55,647 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,647 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:55,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:55,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:55,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:55,647 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:55,647 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:55,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,648 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,648 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,649 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,649 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,649 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,649 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,649 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:07:55,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 23:07:55,649 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,649 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:55,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 23:07:55,654 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:55,654 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 184 2023-07-24 23:07:55,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,655 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testEmptyExportFileSystemState from table testtb-testEmptyExportFileSystemState type FLUSH 2023-07-24 23:07:55,658 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,659 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:55,659 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:55,659 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,660 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:55,660 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:55,662 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:55,662 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:55,663 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:55,662 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:55,663 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:55,663 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:55,666 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,666 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:55,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:55,667 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,667 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,667 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:55,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:55,667 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,668 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:55,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:55,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:55,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 23:07:55,674 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42b78c91[Count = 1] remaining members to acquire global barrier 2023-07-24 23:07:55,677 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,677 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testEmptyExportFileSystemState' with timeout 300000ms 2023-07-24 23:07:55,677 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:07:55,684 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:55,684 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testEmptyExportFileSystemState' starting 'acquire' stage 2023-07-24 23:07:55,684 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally acquired 2023-07-24 23:07:55,684 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (snaptb0-testEmptyExportFileSystemState) in zk 2023-07-24 23:07:55,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:55,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:55,685 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:07:55,686 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,686 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:55,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:55,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:55,687 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,687 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testEmptyExportFileSystemState' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:07:55,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:55,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:55,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure 'snaptb0-testEmptyExportFileSystemState' on coordinator 2023-07-24 23:07:55,692 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42b78c91[Count = 0] remaining members to acquire global barrier 2023-07-24 23:07:55,692 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testEmptyExportFileSystemState' starting 'in-barrier' execution. 2023-07-24 23:07:55,692 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,698 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,699 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:55,699 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,699 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,699 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:55,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,699 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:55,699 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:55,699 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:55,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,699 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:55,700 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:07:55,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,700 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. started... 2023-07-24 23:07:55,700 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:55,699 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testEmptyExportFileSystemState' received 'reached' from coordinator. 2023-07-24 23:07:55,700 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 4b3a4aef5b4eeab83a105c3c9b8d61c1 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 23:07:55,700 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:55,700 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:07:55,702 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:55,702 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:55,702 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:55,704 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:07:55,704 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:07:55,721 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:55,722 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. started... 2023-07-24 23:07:55,722 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 40459561cdc0c6c7744ccc3bb654e3fe 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 23:07:55,845 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202307243d1c9cd939864ab2bc5cfa10a1f96d07 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307243d1c9cd939864ab2bc5cfa10a1f96d07 2023-07-24 23:07:55,845 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307246dba8f3b0c234a52ab9dda0a818814a6 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307246dba8f3b0c234a52ab9dda0a818814a6 2023-07-24 23:07:55,886 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:55,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:55,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:55,888 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:07:55,923 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/.tmp/cf/c48300d282d840a1b83638a27b6836c4 2023-07-24 23:07:55,925 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/.tmp/cf/e2492406b9824e1d85a9be9a221cb18a 2023-07-24 23:07:55,932 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/.tmp/cf/c48300d282d840a1b83638a27b6836c4 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/cf/c48300d282d840a1b83638a27b6836c4 2023-07-24 23:07:55,933 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/.tmp/cf/e2492406b9824e1d85a9be9a221cb18a as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/cf/e2492406b9824e1d85a9be9a221cb18a 2023-07-24 23:07:55,947 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/cf/e2492406b9824e1d85a9be9a221cb18a, entries=2, sequenceid=6, filesize=5.2 K 2023-07-24 23:07:55,948 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/cf/c48300d282d840a1b83638a27b6836c4, entries=48, sequenceid=6, filesize=13.2 K 2023-07-24 23:07:55,949 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for 40459561cdc0c6c7744ccc3bb654e3fe in 227ms, sequenceid=6, compaction requested=false 2023-07-24 23:07:55,949 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testEmptyExportFileSystemState' 2023-07-24 23:07:55,950 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 40459561cdc0c6c7744ccc3bb654e3fe: 2023-07-24 23:07:55,950 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,952 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:55,952 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/cf/e2492406b9824e1d85a9be9a221cb18a] hfiles 2023-07-24 23:07:55,952 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/cf/e2492406b9824e1d85a9be9a221cb18a for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,953 INFO [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 4b3a4aef5b4eeab83a105c3c9b8d61c1 in 252ms, sequenceid=6, compaction requested=false 2023-07-24 23:07:55,954 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 4b3a4aef5b4eeab83a105c3c9b8d61c1: 2023-07-24 23:07:55,954 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:55,954 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:07:55,954 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/cf/c48300d282d840a1b83638a27b6836c4] hfiles 2023-07-24 23:07:55,954 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/cf/c48300d282d840a1b83638a27b6836c4 for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,023 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. completed. 2023-07-24 23:07:56,023 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:07:56,023 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:56,023 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:56,023 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,026 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:56,027 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:07:56,028 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,029 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:56,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:56,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:56,029 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:56,029 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:56,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:56,031 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. completed. 2023-07-24 23:07:56,031 DEBUG [rs(jenkins-hbase4.apache.org,39257,1690239969778)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:07:56,031 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:07:56,031 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:07:56,031 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,031 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testEmptyExportFileSystemState' locally completed 2023-07-24 23:07:56,031 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testEmptyExportFileSystemState' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:07:56,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:56,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,033 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testEmptyExportFileSystemState' has notified controller of completion 2023-07-24 23:07:56,033 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:56,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,033 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,033 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testEmptyExportFileSystemState' completed. 2023-07-24 23:07:56,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:56,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:56,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:56,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,34249,1690239969818': 2023-07-24 23:07:56,039 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 1 more 2023-07-24 23:07:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:56,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:56,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:56,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:56,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:56,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:56,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testEmptyExportFileSystemState' member 'jenkins-hbase4.apache.org,39257,1690239969778': 2023-07-24 23:07:56,046 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' released barrier for procedure'snaptb0-testEmptyExportFileSystemState', counting down latch. Waiting for 0 more 2023-07-24 23:07:56,046 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testEmptyExportFileSystemState' execution completed 2023-07-24 23:07:56,047 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:07:56,047 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:07:56,047 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,047 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testEmptyExportFileSystemStateincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:07:56,049 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,049 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:56,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,049 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,049 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:56,049 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:56,050 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:56,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,050 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:07:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:07:56,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:56,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:07:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,052 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,053 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:56,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:07:56,053 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:56,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:07:56,056 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,056 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,057 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:56,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,062 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:56,062 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:56,062 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:56,062 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:56,062 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,062 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:07:56,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:56,062 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:56,062 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:07:56,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:07:56,062 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:07:56,063 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:07:56,063 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:56,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:56,062 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:56,063 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:56,065 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testEmptyExportFileSystemState 2023-07-24 23:07:56,065 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,065 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 37e3865d2ff7e5e2da33a03e3f723df0, NAME => 'testtb-testEmptyExportFileSystemState,.mob,0.37e3865d2ff7e5e2da33a03e3f723df0.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:56,066 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:07:56,066 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:07:56,066 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:07:56,065 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,066 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:07:56,066 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,066 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:07:56,066 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:07:56,066 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,066 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307243d1c9cd939864ab2bc5cfa10a1f96d07, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307246dba8f3b0c234a52ab9dda0a818814a6] mob files 2023-07-24 23:07:56,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307243d1c9cd939864ab2bc5cfa10a1f96d07 2023-07-24 23:07:56,067 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307246dba8f3b0c234a52ab9dda0a818814a6 2023-07-24 23:07:56,090 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,091 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,188 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:56,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:56,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:56,189 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 23:07:56,238 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,689 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:56,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:56,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:07:56,691 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-24 23:07:56,696 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed 2023-07-24 23:07:56,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,697 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:56,697 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testEmptyExportFileSystemState C_M_SNAPSHOT_TABLE on table testtb-testEmptyExportFileSystemState at 1690240075581Completed referencing HFiles for the mob region of table: testtb-testEmptyExportFileSystemState at 1690240076090 (+509 ms)Consolidate snapshot: snaptb0-testEmptyExportFileSystemState at 1690240076090Loading Region manifests for snaptb0-testEmptyExportFileSystemState at 1690240076090Writing data manifest for snaptb0-testEmptyExportFileSystemState at 1690240076119 (+29 ms)Verifying snapshot: snaptb0-testEmptyExportFileSystemState at 1690240076196 (+77 ms)Snapshot snaptb0-testEmptyExportFileSystemState of table testtb-testEmptyExportFileSystemState completed at 1690240076696 (+500 ms) 2023-07-24 23:07:56,703 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=98, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED 2023-07-24 23:07:56,707 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=98, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testEmptyExportFileSystemState, type=SHARED in 1.1210 sec 2023-07-24 23:07:57,513 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0005_000001 (auth:SIMPLE) 2023-07-24 23:07:57,691 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:07:57,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 } is done 2023-07-24 23:07:57,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testEmptyExportFileSystemState table=testtb-testEmptyExportFileSystemState type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:07:57,693 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240077693 2023-07-24 23:07:57,693 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33513, tgtDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240077693, rawTgtDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240077693, srcFsUri=hdfs://localhost:33513, srcDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:07:57,753 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:07:57,753 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1763275170_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240077693, skipTmp=false, initialOutputSnapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240077693/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:57,753 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316, snapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState. 2023-07-24 23:07:57,805 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240077693/.hbase-snapshot/.tmp/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:07:58,105 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,106 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,106 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,107 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,107 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,107 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,108 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,238 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop-7535937246784405722.jar 2023-07-24 23:07:58,238 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,239 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,240 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,240 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,241 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,241 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:07:58,242 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:07:58,242 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:07:58,243 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:07:58,243 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:07:58,244 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:07:58,245 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:07:58,245 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:07:58,245 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:07:58,245 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:07:58,246 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:07:58,247 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:58,247 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:58,248 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:58,248 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:58,248 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:07:58,249 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:58,249 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:07:58,935 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:07:59,735 WARN [Listener at jenkins-hbase4.apache.org/36985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:07:59,740 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(578): Loading Snapshot 'emptySnaptb0-testEmptyExportFileSystemState' hfile list 2023-07-24 23:07:59,914 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:07:59,914 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:08:00,512 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0006_000001 (auth:SIMPLE) 2023-07-24 23:08:05,292 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0006_000001 (auth:SIMPLE) 2023-07-24 23:08:08,229 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:08:08,230 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:08:08,235 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1127): Export Completed: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:08:08,235 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:08:08,236 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:08:08,236 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:08:08,236 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 23:08:08,237 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 23:08:08,237 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240077693/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240077693/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:08:08,237 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240077693/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/.snapshotinfo 2023-07-24 23:08:08,237 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240077693/.hbase-snapshot/emptySnaptb0-testEmptyExportFileSystemState/data.manifest 2023-07-24 23:08:08,243 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$15(890): Started disable of testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,243 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=99, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,250 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 23:08:08,250 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240088250"}]},"ts":"1690240088250"} 2023-07-24 23:08:08,252 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLING in hbase:meta 2023-07-24 23:08:08,255 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set testtb-testEmptyExportFileSystemState to state=DISABLING 2023-07-24 23:08:08,257 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40459561cdc0c6c7744ccc3bb654e3fe, UNASSIGN}, {pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b3a4aef5b4eeab83a105c3c9b8d61c1, UNASSIGN}] 2023-07-24 23:08:08,259 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=101, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b3a4aef5b4eeab83a105c3c9b8d61c1, UNASSIGN 2023-07-24 23:08:08,259 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=99, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40459561cdc0c6c7744ccc3bb654e3fe, UNASSIGN 2023-07-24 23:08:08,260 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4b3a4aef5b4eeab83a105c3c9b8d61c1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:08,260 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=40459561cdc0c6c7744ccc3bb654e3fe, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:08,260 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240088260"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240088260"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240088260"}]},"ts":"1690240088260"} 2023-07-24 23:08:08,260 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240088260"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240088260"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240088260"}]},"ts":"1690240088260"} 2023-07-24 23:08:08,261 INFO [PEWorker-2] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=102, ppid=101, state=RUNNABLE; CloseRegionProcedure 4b3a4aef5b4eeab83a105c3c9b8d61c1, server=jenkins-hbase4.apache.org,39257,1690239969778}] 2023-07-24 23:08:08,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=103, ppid=100, state=RUNNABLE; CloseRegionProcedure 40459561cdc0c6c7744ccc3bb654e3fe, server=jenkins-hbase4.apache.org,34249,1690239969818}] 2023-07-24 23:08:08,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 23:08:08,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:08:08,416 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:08:08,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4b3a4aef5b4eeab83a105c3c9b8d61c1, disabling compactions & flushes 2023-07-24 23:08:08,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:08:08,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:08:08,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 40459561cdc0c6c7744ccc3bb654e3fe, disabling compactions & flushes 2023-07-24 23:08:08,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. after waiting 0 ms 2023-07-24 23:08:08,417 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:08:08,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:08:08,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:08:08,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. after waiting 0 ms 2023-07-24 23:08:08,417 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:08:08,432 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:08:08,433 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:08,434 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe. 2023-07-24 23:08:08,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 40459561cdc0c6c7744ccc3bb654e3fe: 2023-07-24 23:08:08,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:08:08,435 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:08:08,435 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:08,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1. 2023-07-24 23:08:08,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4b3a4aef5b4eeab83a105c3c9b8d61c1: 2023-07-24 23:08:08,437 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=40459561cdc0c6c7744ccc3bb654e3fe, regionState=CLOSED 2023-07-24 23:08:08,437 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240088437"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240088437"}]},"ts":"1690240088437"} 2023-07-24 23:08:08,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:08:08,438 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=101 updating hbase:meta row=4b3a4aef5b4eeab83a105c3c9b8d61c1, regionState=CLOSED 2023-07-24 23:08:08,438 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.","families":{"info":[{"qualifier":"regioninfo","vlen":72,"tag":[],"timestamp":"1690240088438"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240088438"}]},"ts":"1690240088438"} 2023-07-24 23:08:08,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=103, resume processing ppid=100 2023-07-24 23:08:08,442 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=103, ppid=100, state=SUCCESS; CloseRegionProcedure 40459561cdc0c6c7744ccc3bb654e3fe, server=jenkins-hbase4.apache.org,34249,1690239969818 in 177 msec 2023-07-24 23:08:08,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=102, resume processing ppid=101 2023-07-24 23:08:08,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=102, ppid=101, state=SUCCESS; CloseRegionProcedure 4b3a4aef5b4eeab83a105c3c9b8d61c1, server=jenkins-hbase4.apache.org,39257,1690239969778 in 179 msec 2023-07-24 23:08:08,444 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=100, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=40459561cdc0c6c7744ccc3bb654e3fe, UNASSIGN in 186 msec 2023-07-24 23:08:08,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=101, resume processing ppid=99 2023-07-24 23:08:08,446 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=101, ppid=99, state=SUCCESS; TransitRegionStateProcedure table=testtb-testEmptyExportFileSystemState, region=4b3a4aef5b4eeab83a105c3c9b8d61c1, UNASSIGN in 187 msec 2023-07-24 23:08:08,447 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240088447"}]},"ts":"1690240088447"} 2023-07-24 23:08:08,451 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testEmptyExportFileSystemState, state=DISABLED in hbase:meta 2023-07-24 23:08:08,452 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set testtb-testEmptyExportFileSystemState to state=DISABLED 2023-07-24 23:08:08,454 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=99, state=SUCCESS; DisableTableProcedure table=testtb-testEmptyExportFileSystemState in 209 msec 2023-07-24 23:08:08,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=99 2023-07-24 23:08:08,553 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 99 completed 2023-07-24 23:08:08,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=104, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(259): Removing permissions of removed table testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,559 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=104, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,561 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,569 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,569 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,569 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,569 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,570 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 23:08:08,570 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 23:08:08,570 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data PBUF 2023-07-24 23:08:08,571 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,571 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:08,571 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,571 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:08,571 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testEmptyExportFileSystemState with data null 2023-07-24 23:08:08,571 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:08,571 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,571 INFO [zk-permission-watcher-pool-0] access.AuthManager(135): Skipping permission cache refresh because writable data is empty 2023-07-24 23:08:08,571 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:08,572 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:08:08,572 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:08:08,572 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 23:08:08,575 DEBUG [HFileArchiver-14] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/recovered.edits] 2023-07-24 23:08:08,576 DEBUG [HFileArchiver-21] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/recovered.edits] 2023-07-24 23:08:08,585 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/cf/c48300d282d840a1b83638a27b6836c4 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/cf/c48300d282d840a1b83638a27b6836c4 2023-07-24 23:08:08,590 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/cf/e2492406b9824e1d85a9be9a221cb18a to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/cf/e2492406b9824e1d85a9be9a221cb18a 2023-07-24 23:08:08,591 DEBUG [HFileArchiver-14] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1/recovered.edits/9.seqid 2023-07-24 23:08:08,591 DEBUG [HFileArchiver-14] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/4b3a4aef5b4eeab83a105c3c9b8d61c1 2023-07-24 23:08:08,596 DEBUG [HFileArchiver-21] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe/recovered.edits/9.seqid 2023-07-24 23:08:08,596 DEBUG [HFileArchiver-21] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testEmptyExportFileSystemState/40459561cdc0c6c7744ccc3bb654e3fe 2023-07-24 23:08:08,597 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testEmptyExportFileSystemState regions 2023-07-24 23:08:08,597 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 23:08:08,598 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf] 2023-07-24 23:08:08,605 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307243d1c9cd939864ab2bc5cfa10a1f96d07 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/c4ca4238a0b923820dcc509a6f75849b202307243d1c9cd939864ab2bc5cfa10a1f96d07 2023-07-24 23:08:08,611 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307246dba8f3b0c234a52ab9dda0a818814a6 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0/cf/d41d8cd98f00b204e9800998ecf8427e202307246dba8f3b0c234a52ab9dda0a818814a6 2023-07-24 23:08:08,615 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testEmptyExportFileSystemState/37e3865d2ff7e5e2da33a03e3f723df0 2023-07-24 23:08:08,619 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=104, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,630 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testEmptyExportFileSystemState from hbase:meta 2023-07-24 23:08:08,633 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testEmptyExportFileSystemState' descriptor. 2023-07-24 23:08:08,634 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=104, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,634 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testEmptyExportFileSystemState' from region states. 2023-07-24 23:08:08,634 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240088634"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:08,634 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240088634"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:08,636 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:08:08,636 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 40459561cdc0c6c7744ccc3bb654e3fe, NAME => 'testtb-testEmptyExportFileSystemState,,1690240074033.40459561cdc0c6c7744ccc3bb654e3fe.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 4b3a4aef5b4eeab83a105c3c9b8d61c1, NAME => 'testtb-testEmptyExportFileSystemState,1,1690240074033.4b3a4aef5b4eeab83a105c3c9b8d61c1.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:08:08,637 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testEmptyExportFileSystemState' as deleted. 2023-07-24 23:08:08,637 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testEmptyExportFileSystemState","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240088637"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:08,638 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testEmptyExportFileSystemState state from META 2023-07-24 23:08:08,640 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=104, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState 2023-07-24 23:08:08,642 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=104, state=SUCCESS; DeleteTableProcedure table=testtb-testEmptyExportFileSystemState in 86 msec 2023-07-24 23:08:08,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-07-24 23:08:08,674 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testEmptyExportFileSystemState, procId: 104 completed 2023-07-24 23:08:08,683 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testEmptyExportFileSystemState" 2023-07-24 23:08:08,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testEmptyExportFileSystemState 2023-07-24 23:08:08,688 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testEmptyExportFileSystemState" 2023-07-24 23:08:08,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testEmptyExportFileSystemState 2023-07-24 23:08:08,723 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testEmptyExportFileSystemState Thread=760 (was 758) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:36666 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-42 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-39 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:36746 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #9 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-41 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-435372288_1 at /127.0.0.1:52966 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-40 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:34031 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: Thread-4798 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1763275170_17 at /127.0.0.1:53004 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:37439 from appattempt_1690239977613_0006_000001 java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: LogDeleter #3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:1088) java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:809) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=930 (was 906) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=736 (was 548) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 180), AvailableMemoryMB=5396 (was 5231) - AvailableMemoryMB LEAK? - 2023-07-24 23:08:08,723 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-24 23:08:08,753 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(147): before: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=760, OpenFileDescriptor=930, MaxFileDescriptor=60000, SystemLoadAverage=736, ProcessCount=177, AvailableMemoryMB=5457 2023-07-24 23:08:08,754 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=760 is superior to 500 2023-07-24 23:08:08,756 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-07-24 23:08:08,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:08,760 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_PRE_OPERATION 2023-07-24 23:08:08,760 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testtb-testExportFileSystemStateWithSkipTmp" procId is: 105 2023-07-24 23:08:08,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 23:08:08,762 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-07-24 23:08:08,765 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:08,765 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:08,766 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243 empty. 2023-07-24 23:08:08,766 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693 empty. 2023-07-24 23:08:08,766 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:08,766 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:08,766 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 23:08:08,792 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/.tabledesc/.tableinfo.0000000001 2023-07-24 23:08:08,794 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(7675): creating {ENCODED => c96a6baa67e8b71698a834ce06c0b243, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:08:08,795 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0110eda43acc7b5284f4bf015e3c3693, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='testtb-testExportFileSystemStateWithSkipTmp', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp 2023-07-24 23:08:08,830 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:08:08,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1604): Closing c96a6baa67e8b71698a834ce06c0b243, disabling compactions & flushes 2023-07-24 23:08:08,831 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:08,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:08,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. after waiting 0 ms 2023-07-24 23:08:08,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:08,831 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:08,831 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-0] regionserver.HRegion(1558): Region close journal for c96a6baa67e8b71698a834ce06c0b243: 2023-07-24 23:08:08,833 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:08:08,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1604): Closing 0110eda43acc7b5284f4bf015e3c3693, disabling compactions & flushes 2023-07-24 23:08:08,834 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:08,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:08,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. after waiting 0 ms 2023-07-24 23:08:08,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:08,834 INFO [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:08,834 DEBUG [RegionOpenAndInit-testtb-testExportFileSystemStateWithSkipTmp-pool-1] regionserver.HRegion(1558): Region close journal for 0110eda43acc7b5284f4bf015e3c3693: 2023-07-24 23:08:08,846 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ADD_TO_META 2023-07-24 23:08:08,847 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240088847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240088847"}]},"ts":"1690240088847"} 2023-07-24 23:08:08,848 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240088847"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240088847"}]},"ts":"1690240088847"} 2023-07-24 23:08:08,857 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2023-07-24 23:08:08,858 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-07-24 23:08:08,859 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240088858"}]},"ts":"1690240088858"} 2023-07-24 23:08:08,860 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLING in hbase:meta 2023-07-24 23:08:08,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 23:08:08,864 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2023-07-24 23:08:08,865 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2023-07-24 23:08:08,865 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2023-07-24 23:08:08,865 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 2 is on host 0 2023-07-24 23:08:08,865 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2023-07-24 23:08:08,866 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c96a6baa67e8b71698a834ce06c0b243, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0110eda43acc7b5284f4bf015e3c3693, ASSIGN}] 2023-07-24 23:08:08,869 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0110eda43acc7b5284f4bf015e3c3693, ASSIGN 2023-07-24 23:08:08,869 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c96a6baa67e8b71698a834ce06c0b243, ASSIGN 2023-07-24 23:08:08,871 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0110eda43acc7b5284f4bf015e3c3693, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34249,1690239969818; forceNewPlan=false, retain=false 2023-07-24 23:08:08,871 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c96a6baa67e8b71698a834ce06c0b243, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42121,1690239969723; forceNewPlan=false, retain=false 2023-07-24 23:08:09,021 INFO [jenkins-hbase4:40271] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2023-07-24 23:08:09,024 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0110eda43acc7b5284f4bf015e3c3693, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,024 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c96a6baa67e8b71698a834ce06c0b243, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,025 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240089024"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240089024"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240089024"}]},"ts":"1690240089024"} 2023-07-24 23:08:09,025 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240089024"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240089024"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240089024"}]},"ts":"1690240089024"} 2023-07-24 23:08:09,027 INFO [PEWorker-5] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=108, ppid=107, state=RUNNABLE; OpenRegionProcedure 0110eda43acc7b5284f4bf015e3c3693, server=jenkins-hbase4.apache.org,34249,1690239969818}] 2023-07-24 23:08:09,028 INFO [PEWorker-4] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=109, ppid=106, state=RUNNABLE; OpenRegionProcedure c96a6baa67e8b71698a834ce06c0b243, server=jenkins-hbase4.apache.org,42121,1690239969723}] 2023-07-24 23:08:09,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 23:08:09,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:09,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0110eda43acc7b5284f4bf015e3c3693, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.', STARTKEY => '1', ENDKEY => ''} 2023-07-24 23:08:09,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. service=AccessControlService 2023-07-24 23:08:09,186 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:08:09,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp 0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:09,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:08:09,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:09,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:09,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:09,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c96a6baa67e8b71698a834ce06c0b243, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.', STARTKEY => '', ENDKEY => '1'} 2023-07-24 23:08:09,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. service=AccessControlService 2023-07-24 23:08:09,191 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.security.access.AccessController loaded, priority=536870911. 2023-07-24 23:08:09,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testtb-testExportFileSystemStateWithSkipTmp c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:09,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-07-24 23:08:09,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:09,191 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:09,192 INFO [StoreOpener-0110eda43acc7b5284f4bf015e3c3693-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:09,194 INFO [StoreOpener-c96a6baa67e8b71698a834ce06c0b243-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:09,196 DEBUG [StoreOpener-0110eda43acc7b5284f4bf015e3c3693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/cf 2023-07-24 23:08:09,196 DEBUG [StoreOpener-0110eda43acc7b5284f4bf015e3c3693-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/cf 2023-07-24 23:08:09,196 DEBUG [StoreOpener-c96a6baa67e8b71698a834ce06c0b243-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/cf 2023-07-24 23:08:09,197 DEBUG [StoreOpener-c96a6baa67e8b71698a834ce06c0b243-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/cf 2023-07-24 23:08:09,197 INFO [StoreOpener-c96a6baa67e8b71698a834ce06c0b243-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c96a6baa67e8b71698a834ce06c0b243 columnFamilyName cf 2023-07-24 23:08:09,198 INFO [StoreOpener-0110eda43acc7b5284f4bf015e3c3693-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0110eda43acc7b5284f4bf015e3c3693 columnFamilyName cf 2023-07-24 23:08:09,199 INFO [StoreOpener-c96a6baa67e8b71698a834ce06c0b243-1] regionserver.HStore(310): Store=c96a6baa67e8b71698a834ce06c0b243/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:08:09,199 INFO [StoreOpener-0110eda43acc7b5284f4bf015e3c3693-1] regionserver.HStore(310): Store=0110eda43acc7b5284f4bf015e3c3693/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-07-24 23:08:09,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:09,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:09,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:09,201 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:09,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:09,204 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:09,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:08:09,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-07-24 23:08:09,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c96a6baa67e8b71698a834ce06c0b243; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64070477, jitterRate=-0.0452754944562912}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:08:09,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0110eda43acc7b5284f4bf015e3c3693; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60295774, jitterRate=-0.10152295231819153}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-07-24 23:08:09,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c96a6baa67e8b71698a834ce06c0b243: 2023-07-24 23:08:09,207 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0110eda43acc7b5284f4bf015e3c3693: 2023-07-24 23:08:09,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693., pid=108, masterSystemTime=1690240089179 2023-07-24 23:08:09,208 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2336): Post open deploy tasks for testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243., pid=109, masterSystemTime=1690240089180 2023-07-24 23:08:09,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:09,212 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:09,213 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=0110eda43acc7b5284f4bf015e3c3693, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,213 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2363): Finished post open deploy task for testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:09,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:09,213 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240089212"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240089212"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240089212"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240089212"}]},"ts":"1690240089212"} 2023-07-24 23:08:09,213 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=c96a6baa67e8b71698a834ce06c0b243, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,213 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240089213"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1690240089213"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1690240089213"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1690240089213"}]},"ts":"1690240089213"} 2023-07-24 23:08:09,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=108, resume processing ppid=107 2023-07-24 23:08:09,222 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=108, ppid=107, state=SUCCESS; OpenRegionProcedure 0110eda43acc7b5284f4bf015e3c3693, server=jenkins-hbase4.apache.org,34249,1690239969818 in 187 msec 2023-07-24 23:08:09,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=109, resume processing ppid=106 2023-07-24 23:08:09,223 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=109, ppid=106, state=SUCCESS; OpenRegionProcedure c96a6baa67e8b71698a834ce06c0b243, server=jenkins-hbase4.apache.org,42121,1690239969723 in 187 msec 2023-07-24 23:08:09,224 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0110eda43acc7b5284f4bf015e3c3693, ASSIGN in 356 msec 2023-07-24 23:08:09,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=106, resume processing ppid=105 2023-07-24 23:08:09,226 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c96a6baa67e8b71698a834ce06c0b243, ASSIGN in 357 msec 2023-07-24 23:08:09,227 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-07-24 23:08:09,227 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240089227"}]},"ts":"1690240089227"} 2023-07-24 23:08:09,229 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=ENABLED in hbase:meta 2023-07-24 23:08:09,231 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp execute state=CREATE_TABLE_POST_OPERATION 2023-07-24 23:08:09,231 DEBUG [PEWorker-1] access.PermissionStorage(175): Writing permission with rowKey testtb-testExportFileSystemStateWithSkipTmp jenkins: RWXCA 2023-07-24 23:08:09,233 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 23:08:09,236 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:09,236 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:09,236 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:09,237 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 23:08:09,238 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 23:08:09,238 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 23:08:09,239 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:09,240 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=105, state=SUCCESS; CreateTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 482 msec 2023-07-24 23:08:09,240 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF\x0AQ\x0A\x07jenkins\x12F\x08\x03"B\x0A6\x0A\x07default\x12+testtb-testExportFileSystemStateWithSkipTmp \x00 \x01 \x02 \x03 \x04 2023-07-24 23:08:09,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-07-24 23:08:09,366 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 105 completed 2023-07-24 23:08:09,368 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,368 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:09,371 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:08:09,397 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:09,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240089397 (current time:1690240089397). 2023-07-24 23:08:09,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:08:09,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x13412a0f to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:08:09,412 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6aee2214, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:08:09,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:09,422 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36242, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:09,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13412a0f to 127.0.0.1:58202 2023-07-24 23:08:09,423 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:09,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x5cd8b166 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:08:09,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@46d3e9a0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:08:09,438 DEBUG [hconnection-0x5d368dec-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:09,443 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:09,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:09,455 INFO [RS-EventLoopGroup-5-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44630, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:09,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5cd8b166 to 127.0.0.1:58202 2023-07-24 23:08:09,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:09,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 23:08:09,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:08:09,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:09,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:09,464 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=110, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:09,465 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=110, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690240689465 2023-07-24 23:08:09,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:09,466 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,467 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:08:09,468 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:08:09,469 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=110, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:09,469 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:09,470 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=110, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 8 msec 2023-07-24 23:08:09,471 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=111, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:09,472 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=111, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690240689472 2023-07-24 23:08:09,548 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,548 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 23:08:09,548 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:09,550 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 23:08:09,550 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 23:08:09,552 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,552 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:09,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:09,554 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:09,554 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:09,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:09,554 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:09,554 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,554 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,555 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,555 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:08:09,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 23:08:09,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,555 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,556 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:09,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 23:08:09,556 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,557 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:09,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 207 2023-07-24 23:08:09,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,558 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:09,562 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,563 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:09,563 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:09,566 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,567 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:09,568 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,568 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:09,568 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:09,569 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:09,569 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:09,569 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:09,568 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:09,569 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:09,570 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:09,570 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:09,570 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:09,571 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:09,571 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:09,571 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (emptySnaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:09,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:09,571 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:09,571 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:08:09,583 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,583 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:09,583 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:09,584 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,584 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,584 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,584 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,584 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:09,584 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:09,584 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,584 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:09,585 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,585 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:09,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:09,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,585 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,586 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:09,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 23:08:09,587 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76941b1b[Count = 1] remaining members to acquire global barrier 2023-07-24 23:08:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:09,587 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:09,588 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,593 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,594 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:09,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 23:08:09,595 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@76941b1b[Count = 0] remaining members to acquire global barrier 2023-07-24 23:08:09,595 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 23:08:09,595 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,596 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,596 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,596 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,597 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,597 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,597 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:09,597 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,597 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,597 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,597 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:08:09,597 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:09,597 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:09,597 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:09,597 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:08:09,600 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:09,600 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:09,600 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:09,608 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:08:09,609 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:08:09,609 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:08:09,609 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:08:09,609 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:09,609 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. started... 2023-07-24 23:08:09,609 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:09,611 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. started... 2023-07-24 23:08:09,611 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0110eda43acc7b5284f4bf015e3c3693: 2023-07-24 23:08:09,611 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c96a6baa67e8b71698a834ce06c0b243: 2023-07-24 23:08:09,611 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,611 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:08:09,611 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,611 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:08:09,611 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:08:09,611 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [] hfiles 2023-07-24 23:08:09,643 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. completed. 2023-07-24 23:08:09,643 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:08:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:08:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:09,643 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:08:09,646 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:09,646 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,646 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:09,646 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:09,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:09,648 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. completed. 2023-07-24 23:08:09,646 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:09,652 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:09,652 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:08:09,652 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:08:09,652 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,652 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:09,652 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:09,652 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:08:09,654 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:09,654 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:09,654 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:09,656 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:09,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:09,658 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34249,1690239969818': 2023-07-24 23:08:09,660 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 23:08:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:09,661 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:09,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,662 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:09,663 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,664 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42121,1690239969723': 2023-07-24 23:08:09,665 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' released barrier for procedure'emptySnaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 23:08:09,665 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'emptySnaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 23:08:09,665 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:08:09,666 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:08:09,666 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,666 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure emptySnaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:08:09,668 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:09,668 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:09,668 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:09,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,668 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,668 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,669 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,669 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:09,669 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,670 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:09,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:09,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,671 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,672 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:09,673 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,673 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,676 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:09,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:09,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,677 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,677 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:09,678 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,680 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,680 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:08:09,680 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:09,680 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:09,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:09,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:09,680 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:09,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:09,680 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:09,681 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:09,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:09,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:09,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:09,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:09,681 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:09,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:09,685 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(211): No mob files under family: cf 2023-07-24 23:08:09,718 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,719 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,772 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:09,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:09,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:09,773 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:08:09,840 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,937 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 23:08:09,937 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,938 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:09,938 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690240089466Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690240089718 (+252 ms)Consolidate snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690240089718Loading Region manifests for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690240089718Writing data manifest for emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690240089724 (+6 ms)Verifying snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp at 1690240089828 (+104 ms)Snapshot emptySnaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690240089937 (+109 ms) 2023-07-24 23:08:09,941 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=111, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:09,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=111, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 474 msec 2023-07-24 23:08:10,073 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:10,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:10,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=emptySnaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:08:10,083 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42121] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:08:10,088 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34249] regionserver.HRegion(8805): writing data to region testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. with WAL disabled. Data may be lost in the event of a crash. 2023-07-24 23:08:10,091 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2627): Found 2 regions for table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,092 DEBUG [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2633): firstRegionName=testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:10,092 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-07-24 23:08:10,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:10,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1690240090106 (current time:1690240090106). 2023-07-24 23:08:10,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-07-24 23:08:10,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x6d09c8ce to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:08:10,134 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@439616e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:08:10,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:10,141 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36246, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:10,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d09c8ce to 127.0.0.1:58202 2023-07-24 23:08:10,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:10,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(139): Connect 0x4b067f89 to 127.0.0.1:58202 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-07-24 23:08:10,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@68ea919f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-07-24 23:08:10,167 DEBUG [hconnection-0x2797bffd-metaLookup-shared--pool-0] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:10,171 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36254, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:10,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.RpcConnection(124): Using SIMPLE authentication for service=ClientService, sasl=false 2023-07-24 23:08:10,177 INFO [RS-EventLoopGroup-5-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-07-24 23:08:10,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b067f89 to 127.0.0.1:58202 2023-07-24 23:08:10,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:10,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(611): Read acl: entry[testtb-testExportFileSystemStateWithSkipTmp], kv [jenkins: RWXCA] 2023-07-24 23:08:10,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(601): No existing snapshot, attempting snapshot... 2023-07-24 23:08:10,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(648): Table enabled, starting distributed snapshots for { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:10,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:10,184 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=112, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:10,185 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=112, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE; timeout=600000, timestamp=1690240690185 2023-07-24 23:08:10,185 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(653): Started snapshot: { ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } 2023-07-24 23:08:10,187 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }'' to complete. (max 20000 ms per retry) 2023-07-24 23:08:10,187 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-07-24 23:08:10,188 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=112, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE 2023-07-24 23:08:10,189 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1029): Stored pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:10,191 INFO [PEWorker-2] procedure2.ProcedureExecutor(1410): Finished pid=112, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=EXCLUSIVE in 6 msec 2023-07-24 23:08:10,192 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=113, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:10,193 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=113, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED; timeout=600000, timestamp=1690240690193 2023-07-24 23:08:10,224 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,226 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' 2023-07-24 23:08:10,227 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:10,229 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' 2023-07-24 23:08:10,229 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb0-testExportFileSystemStateWithSkipTmp', kicking off acquire phase on members. 2023-07-24 23:08:10,287 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:10,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:10,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:10,289 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-07-24 23:08:10,296 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,296 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,300 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:10,300 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:10,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:10,301 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:10,300 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:10,300 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:10,301 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:10,301 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:10,301 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,302 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,302 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-07-24 23:08:10,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,302 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 23:08:10,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,302 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 23:08:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 202 2023-07-24 23:08:10,303 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:10,303 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb0-testExportFileSystemStateWithSkipTmp from table testtb-testExportFileSystemStateWithSkipTmp type FLUSH 2023-07-24 23:08:10,312 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,312 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:10,313 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:10,313 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,313 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:10,313 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:10,320 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:10,320 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:10,320 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,320 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:10,320 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:10,320 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' with timeout 300000ms 2023-07-24 23:08:10,320 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:10,320 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-07-24 23:08:10,320 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,39257,1690239969778' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:10,322 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'acquire' stage 2023-07-24 23:08:10,322 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally acquired 2023-07-24 23:08:10,322 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure (snaptb0-testExportFileSystemStateWithSkipTmp) in zk 2023-07-24 23:08:10,324 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,324 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,324 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:10,324 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:10,324 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,324 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,325 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,325 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:10,324 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:10,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:10,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:10,327 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,327 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-07-24 23:08:10,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:10,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:10,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:10,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,34249,1690239969818' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 23:08:10,329 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73e57020[Count = 1] remaining members to acquire global barrier 2023-07-24 23:08:10,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:10,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:10,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:10,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:10,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:10,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:10,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:10,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:10,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,42121,1690239969723' joining acquired barrier for procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' on coordinator 2023-07-24 23:08:10,332 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@73e57020[Count = 0] remaining members to acquire global barrier 2023-07-24 23:08:10,332 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' starting 'in-barrier' execution. 2023-07-24 23:08:10,332 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,341 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,341 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,341 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,341 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,341 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,341 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:10,341 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,341 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,39257,1690239969778' in zk 2023-07-24 23:08:10,341 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:10,341 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,341 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' received 'reached' from coordinator. 2023-07-24 23:08:10,341 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:08:10,342 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:08:10,342 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:10,342 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:10,342 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 1 regions 2023-07-24 23:08:10,342 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-07-24 23:08:10,342 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. started... 2023-07-24 23:08:10,342 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:10,342 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-07-24 23:08:10,342 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. started... 2023-07-24 23:08:10,342 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2745): Flushing 0110eda43acc7b5284f4bf015e3c3693 1/1 column families, dataSize=3.13 KB heapSize=7 KB 2023-07-24 23:08:10,342 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2745): Flushing c96a6baa67e8b71698a834ce06c0b243 1/1 column families, dataSize=132 B heapSize=544 B 2023-07-24 23:08:10,343 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:10,343 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:10,343 DEBUG [member: 'jenkins-hbase4.apache.org,39257,1690239969778' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:10,438 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20230724403aae7bbaa243899095a14829842a4c to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724403aae7bbaa243899095a14829842a4c 2023-07-24 23:08:10,450 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202307246b3ac11b870b476489637587bf0d2fac to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307246b3ac11b870b476489637587bf0d2fac 2023-07-24 23:08:10,489 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:10,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:10,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:10,491 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-07-24 23:08:10,551 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=132, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/.tmp/cf/d590630603014f839bdfef3c2b395b84 2023-07-24 23:08:10,571 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=6, memsize=3.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/.tmp/cf/4e7e7292616a418bbdab55b1644c16d4 2023-07-24 23:08:10,573 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/.tmp/cf/d590630603014f839bdfef3c2b395b84 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/cf/d590630603014f839bdfef3c2b395b84 2023-07-24 23:08:10,579 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/.tmp/cf/4e7e7292616a418bbdab55b1644c16d4 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/cf/4e7e7292616a418bbdab55b1644c16d4 2023-07-24 23:08:10,580 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/cf/d590630603014f839bdfef3c2b395b84, entries=2, sequenceid=6, filesize=5.2 K 2023-07-24 23:08:10,581 INFO [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~132 B/132, heapSize ~528 B/528, currentSize=0 B/0 for c96a6baa67e8b71698a834ce06c0b243 in 239ms, sequenceid=6, compaction requested=false 2023-07-24 23:08:10,581 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testtb-testExportFileSystemStateWithSkipTmp' 2023-07-24 23:08:10,582 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for c96a6baa67e8b71698a834ce06c0b243: 2023-07-24 23:08:10,582 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,582 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:08:10,582 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/cf/d590630603014f839bdfef3c2b395b84] hfiles 2023-07-24 23:08:10,582 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/cf/d590630603014f839bdfef3c2b395b84 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,588 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/cf/4e7e7292616a418bbdab55b1644c16d4, entries=48, sequenceid=6, filesize=13.5 K 2023-07-24 23:08:10,589 INFO [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~3.13 KB/3204, heapSize ~6.98 KB/7152, currentSize=0 B/0 for 0110eda43acc7b5284f4bf015e3c3693 in 247ms, sequenceid=6, compaction requested=false 2023-07-24 23:08:10,599 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 0110eda43acc7b5284f4bf015e3c3693: 2023-07-24 23:08:10,599 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,599 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-07-24 23:08:10,599 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/cf/4e7e7292616a418bbdab55b1644c16d4] hfiles 2023-07-24 23:08:10,599 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/1): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/cf/4e7e7292616a418bbdab55b1644c16d4 for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,713 WARN [DataStreamer for file /user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp/region-manifest.0110eda43acc7b5284f4bf015e3c3693] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2023-07-24 23:08:10,714 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. completed. 2023-07-24 23:08:10,714 DEBUG [rs(jenkins-hbase4.apache.org,34249,1690239969818)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:10,714 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:08:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:08:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:10,715 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,34249,1690239969818' in zk 2023-07-24 23:08:10,723 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,723 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:10,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:10,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:10,723 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:10,723 DEBUG [member: 'jenkins-hbase4.apache.org,34249,1690239969818' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:10,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:10,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:10,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:10,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:10,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:10,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:10,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:10,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:10,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,34249,1690239969818': 2023-07-24 23:08:10,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,34249,1690239969818' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 1 more 2023-07-24 23:08:10,791 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:10,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:10,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:10,792 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-07-24 23:08:11,065 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. completed. 2023-07-24 23:08:11,066 DEBUG [rs(jenkins-hbase4.apache.org,42121,1690239969723)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/1 local region snapshots. 2023-07-24 23:08:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 1 local region snapshots. 2023-07-24 23:08:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' locally completed 2023-07-24 23:08:11,066 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed for member 'jenkins-hbase4.apache.org,42121,1690239969723' in zk 2023-07-24 23:08:11,067 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,067 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' has notified controller of completion 2023-07-24 23:08:11,067 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,068 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:11,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:11,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:11,068 DEBUG [member: 'jenkins-hbase4.apache.org,42121,1690239969723' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb0-testExportFileSystemStateWithSkipTmp' completed. 2023-07-24 23:08:11,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:11,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:11,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:11,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:11,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:11,074 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:11,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' member 'jenkins-hbase4.apache.org,42121,1690239969723': 2023-07-24 23:08:11,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,42121,1690239969723' released barrier for procedure'snaptb0-testExportFileSystemStateWithSkipTmp', counting down latch. Waiting for 0 more 2023-07-24 23:08:11,079 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb0-testExportFileSystemStateWithSkipTmp' execution completed 2023-07-24 23:08:11,079 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-07-24 23:08:11,079 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-07-24 23:08:11,079 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,079 INFO [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb0-testExportFileSystemStateWithSkipTmpincluding nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-07-24 23:08:11,087 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,087 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,087 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,087 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,087 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-07-24 23:08:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-07-24 23:08:11,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,087 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:11,087 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,087 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:11,088 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:11,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-07-24 23:08:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:11,088 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,088 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:11,089 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,089 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-07-24 23:08:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-07-24 23:08:11,091 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:11,091 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,092 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:11,092 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] zookeeper.ZKUtil(162): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:11,092 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,093 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:11,095 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:11,095 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:11,095 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:11,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:11,095 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:11,095 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-07-24 23:08:11,096 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:11,095 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,096 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:11,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:11,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,095 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-07-24 23:08:11,095 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-07-24 23:08:11,096 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:11,096 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-07-24 23:08:11,096 DEBUG [(jenkins-hbase4.apache.org,40271,1690239968260)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-07-24 23:08:11,096 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,096 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => e9516f04c7d2974b21addb190acc6c0a, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,.mob,0.e9516f04c7d2974b21addb190acc6c0a.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:11,096 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:11,098 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-07-24 23:08:11,098 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:11,098 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-07-24 23:08:11,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-07-24 23:08:11,098 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,099 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:11,099 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,099 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:11,099 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:11,099 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,099 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724403aae7bbaa243899095a14829842a4c, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307246b3ac11b870b476489637587bf0d2fac] mob files 2023-07-24 23:08:11,099 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724403aae7bbaa243899095a14829842a4c 2023-07-24 23:08:11,100 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/2): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307246b3ac11b870b476489637587bf0d2fac 2023-07-24 23:08:11,109 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,110 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,293 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:11,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:11,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(404): Snapshoting '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' is still in progress! 2023-07-24 23:08:11,294 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-07-24 23:08:11,553 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,593 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed 2023-07-24 23:08:11,593 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,594 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/.tmp/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:11,594 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb0-testExportFileSystemStateWithSkipTmp C_M_SNAPSHOT_TABLE on table testtb-testExportFileSystemStateWithSkipTmp at 1690240090185Completed referencing HFiles for the mob region of table: testtb-testExportFileSystemStateWithSkipTmp at 1690240091109 (+924 ms)Consolidate snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690240091109Loading Region manifests for snaptb0-testExportFileSystemStateWithSkipTmp at 1690240091109Writing data manifest for snaptb0-testExportFileSystemStateWithSkipTmp at 1690240091117 (+8 ms)Verifying snapshot: snaptb0-testExportFileSystemStateWithSkipTmp at 1690240091545 (+428 ms)Snapshot snaptb0-testExportFileSystemStateWithSkipTmp of table testtb-testExportFileSystemStateWithSkipTmp completed at 1690240091593 (+48 ms) 2023-07-24 23:08:11,597 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=113, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED 2023-07-24 23:08:11,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=113, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testtb-testExportFileSystemStateWithSkipTmp, type=SHARED in 1.4100 sec 2023-07-24 23:08:12,294 DEBUG [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-07-24 23:08:12,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 } is done 2023-07-24 23:08:12,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(401): Snapshot '{ ss=snaptb0-testExportFileSystemStateWithSkipTmp table=testtb-testExportFileSystemStateWithSkipTmp type=FLUSH ttl=0 }' has completed, notifying client. 2023-07-24 23:08:12,296 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(381): HDFS export destination path: hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240092296 2023-07-24 23:08:12,296 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(255): tgtFsUri=hdfs://localhost:33513, tgtDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240092296, rawTgtDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240092296, srcFsUri=hdfs://localhost:33513, srcDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:08:12,331 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(998): inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316 2023-07-24 23:08:12,331 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(999): outputFs=DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1611828977_17, ugi=jenkins (auth:SIMPLE)]], outputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240092296, skipTmp=true, initialOutputSnapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240092296/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:12,331 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1004): Verify snapshot source, inputFs=hdfs://localhost:33513, inputRoot=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316, snapshotDir=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp. 2023-07-24 23:08:12,372 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1063): Copy Snapshot Manifest from hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240092296/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:12,474 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.HConstants, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-common/target/hbase-common-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,475 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol/target/hbase-protocol-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,475 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-protocol-shaded/target/hbase-protocol-shaded-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,476 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.client.Put, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-client/target/hbase-client-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,476 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.ipc.RpcServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/hbase-server-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,476 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.CompatibilityFactory, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop-compat/target/hbase-hadoop-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,477 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.JobUtil, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-hadoop2-compat/target/hbase-hadoop2-compat-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,574 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.mapreduce.TableMapper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/hadoop-5394884073586675236.jar 2023-07-24 23:08:12,575 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.impl.FastLongHistogram, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics/target/hbase-metrics-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,576 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.metrics.Snapshot, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-metrics-api/target/hbase-metrics-api-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,576 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.replication.ReplicationUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-replication/target/hbase-replication-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,577 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.http.HttpServer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-http/target/hbase-http-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,578 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.procedure2.Procedure, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-procedure/target/hbase-procedure-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,578 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.zookeeper.ZKWatcher, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-zookeeper/target/hbase-zookeeper-2.4.18-SNAPSHOT.jar 2023-07-24 23:08:12,579 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.common.collect.Lists, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-miscellaneous/4.1.4/hbase-shaded-miscellaneous-4.1.4.jar 2023-07-24 23:08:12,580 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.gson.GsonBuilder, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-gson/4.1.4/hbase-shaded-gson-4.1.4.jar 2023-07-24 23:08:12,580 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-protobuf/4.1.4/hbase-shaded-protobuf-4.1.4.jar 2023-07-24 23:08:12,581 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hbase.thirdparty.io.netty.channel.Channel, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-shaded-netty/4.1.4/hbase-shaded-netty-4.1.4.jar 2023-07-24 23:08:12,581 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.hbase.unsafe.HBasePlatformDependent, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hbase/thirdparty/hbase-unsafe/4.1.4/hbase-unsafe-4.1.4.jar 2023-07-24 23:08:12,582 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.zookeeper.ZooKeeper, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/zookeeper/zookeeper/3.5.7/zookeeper-3.5.7.jar 2023-07-24 23:08:12,582 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.google.protobuf.Message, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/com/google/protobuf/protobuf-java/2.5.0/protobuf-java-2.5.0.jar 2023-07-24 23:08:12,582 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.htrace.core.Tracer, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/htrace/htrace-core4/4.2.0-incubating/htrace-core4-4.2.0-incubating.jar 2023-07-24 23:08:12,583 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class com.codahale.metrics.MetricRegistry, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/io/dropwizard/metrics/metrics-core/3.2.6/metrics-core-3.2.6.jar 2023-07-24 23:08:12,583 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.commons.lang3.ArrayUtils, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/commons/commons-lang3/3.9/commons-lang3-3.9.jar 2023-07-24 23:08:12,584 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:08:12,584 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:08:12,584 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.input.TextInputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:08:12,585 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.LongWritable, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:08:12,585 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.io.Text, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-common/2.10.0/hadoop-common-2.10.0.jar 2023-07-24 23:08:12,585 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.output.TextOutputFormat, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:08:12,586 DEBUG [Listener at jenkins-hbase4.apache.org/36985] mapreduce.TableMapReduceUtil(866): For class org.apache.hadoop.mapreduce.lib.partition.HashPartitioner, using jar /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-mapreduce-client-core/2.10.0/hadoop-mapreduce-client-core-2.10.0.jar 2023-07-24 23:08:12,842 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0006_000001 (auth:SIMPLE) 2023-07-24 23:08:14,088 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:08:14,482 WARN [Listener at jenkins-hbase4.apache.org/36985] mapreduce.JobResourceUploader(470): No job jar file set. User classes may not be found. See Job or Job#setJar(String). 2023-07-24 23:08:14,485 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(578): Loading Snapshot 'snaptb0-testExportFileSystemStateWithSkipTmp' hfile list 2023-07-24 23:08:14,487 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(671): export split=0 size=31.5 K 2023-07-24 23:08:14,574 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(825): maximum-am-resource-percent is insufficient to start a single application in queue, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:08:14,575 WARN [SchedulerEventDispatcher:Event Processor] capacity.LeafQueue(861): maximum-am-resource-percent is insufficient to start a single application in queue for user, it is likely set too low. skipping enforcement to allow at least one application to start 2023-07-24 23:08:14,619 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0007_000001 (auth:SIMPLE) 2023-07-24 23:08:20,196 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0007_000001 (auth:SIMPLE) 2023-07-24 23:08:22,541 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0007_000001 (auth:SIMPLE) 2023-07-24 23:08:26,047 INFO [Socket Reader #1 for port 0] ipc.Server$Connection(1979): Auth successful for appattempt_1690239977613_0007_000001 (auth:SIMPLE) 2023-07-24 23:08:27,738 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1112): Finalize the Snapshot Export 2023-07-24 23:08:27,738 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1123): Verify snapshot integrity 2023-07-24 23:08:27,769 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.ExportSnapshot(1127): Export Completed: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:27,769 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(279): Exported snapshot 2023-07-24 23:08:27,770 INFO [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(290): Verified filesystem state 2023-07-24 23:08:27,770 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:27,770 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 23:08:27,771 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 23:08:27,771 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(362): List files in DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_1202603404_17, ugi=jenkins (auth:SIMPLE)]] in root hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240092296/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp at hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240092296/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:27,771 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240092296/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/.snapshotinfo 2023-07-24 23:08:27,771 DEBUG [Listener at jenkins-hbase4.apache.org/36985] snapshot.TestExportSnapshot(367): hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/export-test/export-1690240092296/.hbase-snapshot/snaptb0-testExportFileSystemStateWithSkipTmp/data.manifest 2023-07-24 23:08:27,779 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$15(890): Started disable of testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:27,780 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:27,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=114, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:27,788 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240107788"}]},"ts":"1690240107788"} 2023-07-24 23:08:27,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 23:08:27,790 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLING in hbase:meta 2023-07-24 23:08:27,792 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLING 2023-07-24 23:08:27,793 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c96a6baa67e8b71698a834ce06c0b243, UNASSIGN}, {pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0110eda43acc7b5284f4bf015e3c3693, UNASSIGN}] 2023-07-24 23:08:27,794 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=116, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0110eda43acc7b5284f4bf015e3c3693, UNASSIGN 2023-07-24 23:08:27,797 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=115, ppid=114, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c96a6baa67e8b71698a834ce06c0b243, UNASSIGN 2023-07-24 23:08:27,798 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0110eda43acc7b5284f4bf015e3c3693, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:27,798 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c96a6baa67e8b71698a834ce06c0b243, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:27,798 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240107797"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240107797"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240107797"}]},"ts":"1690240107797"} 2023-07-24 23:08:27,798 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240107798"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1690240107798"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1690240107798"}]},"ts":"1690240107798"} 2023-07-24 23:08:27,802 INFO [PEWorker-1] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=117, ppid=115, state=RUNNABLE; CloseRegionProcedure c96a6baa67e8b71698a834ce06c0b243, server=jenkins-hbase4.apache.org,42121,1690239969723}] 2023-07-24 23:08:27,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1681): Initialized subprocedures=[{pid=118, ppid=116, state=RUNNABLE; CloseRegionProcedure 0110eda43acc7b5284f4bf015e3c3693, server=jenkins-hbase4.apache.org,34249,1690239969818}] 2023-07-24 23:08:27,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 23:08:27,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:27,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c96a6baa67e8b71698a834ce06c0b243, disabling compactions & flushes 2023-07-24 23:08:27,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:27,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:27,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. after waiting 0 ms 2023-07-24 23:08:27,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:27,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:27,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0110eda43acc7b5284f4bf015e3c3693, disabling compactions & flushes 2023-07-24 23:08:27,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:27,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:27,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. after waiting 0 ms 2023-07-24 23:08:27,960 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:27,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:08:27,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:08:27,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:27,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243. 2023-07-24 23:08:27,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c96a6baa67e8b71698a834ce06c0b243: 2023-07-24 23:08:27,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:27,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693. 2023-07-24 23:08:27,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0110eda43acc7b5284f4bf015e3c3693: 2023-07-24 23:08:27,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:27,988 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=115 updating hbase:meta row=c96a6baa67e8b71698a834ce06c0b243, regionState=CLOSED 2023-07-24 23:08:27,989 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240107988"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240107988"}]},"ts":"1690240107988"} 2023-07-24 23:08:27,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:27,989 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=116 updating hbase:meta row=0110eda43acc7b5284f4bf015e3c3693, regionState=CLOSED 2023-07-24 23:08:27,989 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.","families":{"info":[{"qualifier":"regioninfo","vlen":78,"tag":[],"timestamp":"1690240107989"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1690240107989"}]},"ts":"1690240107989"} 2023-07-24 23:08:27,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=117, resume processing ppid=115 2023-07-24 23:08:27,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=117, ppid=115, state=SUCCESS; CloseRegionProcedure c96a6baa67e8b71698a834ce06c0b243, server=jenkins-hbase4.apache.org,42121,1690239969723 in 188 msec 2023-07-24 23:08:27,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=118, resume processing ppid=116 2023-07-24 23:08:27,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=118, ppid=116, state=SUCCESS; CloseRegionProcedure 0110eda43acc7b5284f4bf015e3c3693, server=jenkins-hbase4.apache.org,34249,1690239969818 in 188 msec 2023-07-24 23:08:27,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1410): Finished pid=115, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=c96a6baa67e8b71698a834ce06c0b243, UNASSIGN in 199 msec 2023-07-24 23:08:27,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1824): Finished subprocedure pid=116, resume processing ppid=114 2023-07-24 23:08:27,996 INFO [PEWorker-1] procedure2.ProcedureExecutor(1410): Finished pid=116, ppid=114, state=SUCCESS; TransitRegionStateProcedure table=testtb-testExportFileSystemStateWithSkipTmp, region=0110eda43acc7b5284f4bf015e3c3693, UNASSIGN in 200 msec 2023-07-24 23:08:27,996 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1690240107996"}]},"ts":"1690240107996"} 2023-07-24 23:08:27,997 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testtb-testExportFileSystemStateWithSkipTmp, state=DISABLED in hbase:meta 2023-07-24 23:08:28,000 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testtb-testExportFileSystemStateWithSkipTmp to state=DISABLED 2023-07-24 23:08:28,002 INFO [PEWorker-3] procedure2.ProcedureExecutor(1410): Finished pid=114, state=SUCCESS; DisableTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 221 msec 2023-07-24 23:08:28,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=114 2023-07-24 23:08:28,092 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 114 completed 2023-07-24 23:08:28,093 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] procedure2.ProcedureExecutor(1029): Stored pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,097 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=119, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] access.PermissionStorage(259): Removing permissions of removed table testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,099 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=119, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,100 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34249] access.PermissionStorage(527): No permissions found in hbase:acl for acl entry testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,110 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,110 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,110 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,110 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 23:08:28,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 23:08:28,111 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 23:08:28,112 DEBUG [zk-permission-watcher-pool-0] access.ZKPermissionWatcher(245): Updating permissions cache from testtb-testExportFileSystemStateWithSkipTmp with data PBUF 2023-07-24 23:08:28,112 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,112 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:28,112 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,112 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:28,112 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,112 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:28,112 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/acl/testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,112 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/acl 2023-07-24 23:08:28,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 23:08:28,119 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:28,127 DEBUG [HFileArchiver-23] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:28,130 DEBUG [HFileArchiver-23] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/recovered.edits] 2023-07-24 23:08:28,131 DEBUG [HFileArchiver-22] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/cf, FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/recovered.edits] 2023-07-24 23:08:28,136 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/cf/4e7e7292616a418bbdab55b1644c16d4 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/cf/4e7e7292616a418bbdab55b1644c16d4 2023-07-24 23:08:28,137 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/cf/d590630603014f839bdfef3c2b395b84 to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/cf/d590630603014f839bdfef3c2b395b84 2023-07-24 23:08:28,147 DEBUG [HFileArchiver-23] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693/recovered.edits/9.seqid 2023-07-24 23:08:28,149 DEBUG [HFileArchiver-23] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/0110eda43acc7b5284f4bf015e3c3693 2023-07-24 23:08:28,150 DEBUG [HFileArchiver-22] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/recovered.edits/9.seqid to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243/recovered.edits/9.seqid 2023-07-24 23:08:28,151 DEBUG [HFileArchiver-22] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/.tmp/data/default/testtb-testExportFileSystemStateWithSkipTmp/c96a6baa67e8b71698a834ce06c0b243 2023-07-24 23:08:28,151 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testtb-testExportFileSystemStateWithSkipTmp regions 2023-07-24 23:08:28,152 DEBUG [PEWorker-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 23:08:28,153 DEBUG [PEWorker-5] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf] 2023-07-24 23:08:28,160 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724403aae7bbaa243899095a14829842a4c to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/c4ca4238a0b923820dcc509a6f75849b20230724403aae7bbaa243899095a14829842a4c 2023-07-24 23:08:28,162 DEBUG [PEWorker-5] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307246b3ac11b870b476489637587bf0d2fac to hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/archive/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a/cf/d41d8cd98f00b204e9800998ecf8427e202307246b3ac11b870b476489637587bf0d2fac 2023-07-24 23:08:28,163 DEBUG [PEWorker-5] backup.HFileArchiver(596): Deleted hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/mobdir/data/default/testtb-testExportFileSystemStateWithSkipTmp/e9516f04c7d2974b21addb190acc6c0a 2023-07-24 23:08:28,165 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=119, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,168 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of testtb-testExportFileSystemStateWithSkipTmp from hbase:meta 2023-07-24 23:08:28,170 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'testtb-testExportFileSystemStateWithSkipTmp' descriptor. 2023-07-24 23:08:28,171 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=119, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,171 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'testtb-testExportFileSystemStateWithSkipTmp' from region states. 2023-07-24 23:08:28,172 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240108172"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:28,172 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1690240108172"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:28,174 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2023-07-24 23:08:28,174 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c96a6baa67e8b71698a834ce06c0b243, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,,1690240088756.c96a6baa67e8b71698a834ce06c0b243.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 0110eda43acc7b5284f4bf015e3c3693, NAME => 'testtb-testExportFileSystemStateWithSkipTmp,1,1690240088756.0110eda43acc7b5284f4bf015e3c3693.', STARTKEY => '1', ENDKEY => ''}] 2023-07-24 23:08:28,174 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'testtb-testExportFileSystemStateWithSkipTmp' as deleted. 2023-07-24 23:08:28,174 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testtb-testExportFileSystemStateWithSkipTmp","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1690240108174"}]},"ts":"9223372036854775807"} 2023-07-24 23:08:28,176 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table testtb-testExportFileSystemStateWithSkipTmp state from META 2023-07-24 23:08:28,179 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=119, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1410): Finished pid=119, state=SUCCESS; DeleteTableProcedure table=testtb-testExportFileSystemStateWithSkipTmp in 86 msec 2023-07-24 23:08:28,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(1230): Checking to see if procedure is done pid=119 2023-07-24 23:08:28,215 INFO [Listener at jenkins-hbase4.apache.org/36985] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testtb-testExportFileSystemStateWithSkipTmp, procId: 119 completed 2023-07-24 23:08:28,224 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "emptySnaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 23:08:28,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: emptySnaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,228 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "snaptb0-testExportFileSystemStateWithSkipTmp" 2023-07-24 23:08:28,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40271] snapshot.SnapshotManager(333): Deleting snapshot: snaptb0-testExportFileSystemStateWithSkipTmp 2023-07-24 23:08:28,261 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(175): after: snapshot.TestMobSecureExportSnapshot#testExportFileSystemStateWithSkipTmp Thread=762 (was 760) Potentially hanging thread: Thread-5437 java.io.FileInputStream.readBytes(Native Method) java.io.FileInputStream.read(FileInputStream.java:255) java.io.BufferedInputStream.read1(BufferedInputStream.java:284) java.io.BufferedInputStream.read(BufferedInputStream.java:345) sun.nio.cs.StreamDecoder.readBytes(StreamDecoder.java:284) sun.nio.cs.StreamDecoder.implRead(StreamDecoder.java:326) sun.nio.cs.StreamDecoder.read(StreamDecoder.java:178) java.io.InputStreamReader.read(InputStreamReader.java:184) java.io.BufferedReader.fill(BufferedReader.java:161) java.io.BufferedReader.readLine(BufferedReader.java:324) java.io.BufferedReader.readLine(BufferedReader.java:389) org.apache.hadoop.util.Shell$1.run(Shell.java:955) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1952154751_1 at /127.0.0.1:33648 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1952154751_1 at /127.0.0.1:56362 [Waiting for operation #2] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-48 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:42164 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:33668 [Waiting for operation #3] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-45 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-46 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_1202603404_17 at /127.0.0.1:56382 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ApplicationMasterLauncher #11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: IPC Client (1899535918) connection to jenkins-hbase4.apache.org/172.31.14.131:45615 from jenkins java.lang.Object.wait(Native Method) org.apache.hadoop.ipc.Client$Connection.waitForWork(Client.java:1035) org.apache.hadoop.ipc.Client$Connection.run(Client.java:1079) Potentially hanging thread: hconnection-0x3f116f51-shared-pool-47 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=906 (was 930), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=745 (was 736) - SystemLoadAverage LEAK? -, ProcessCount=179 (was 177) - ProcessCount LEAK? -, AvailableMemoryMB=4388 (was 5457) 2023-07-24 23:08:28,261 WARN [Listener at jenkins-hbase4.apache.org/36985] hbase.ResourceChecker(130): Thread=762 is superior to 500 2023-07-24 23:08:28,261 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2762): Stopping mini mapreduce cluster... 2023-07-24 23:08:28,274 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 23:08:28,397 WARN [ContainersLauncher #0] nodemanager.DefaultContainerExecutor(305): Exit code from container container_1690239977613_0007_01_000001 is : 143 2023-07-24 23:08:33,581 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-jobhistoryserver.properties,hadoop-metrics2.properties 2023-07-24 23:08:42,434 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 23:08:56,573 ERROR [Thread[Thread-408,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 23:08:56,574 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 23:08:56,694 WARN [ApplicationMaster Launcher] amlauncher.ApplicationMasterLauncher$LauncherThread(122): org.apache.hadoop.yarn.server.resourcemanager.amlauncher.ApplicationMasterLauncher$LauncherThread interrupted. Returning. 2023-07-24 23:08:56,715 ERROR [SchedulerEventDispatcher:Event Processor] event.EventDispatcher$EventProcessor(61): Returning, interrupted : java.lang.InterruptedException 2023-07-24 23:08:56,717 ERROR [Thread[Thread-418,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 23:08:56,742 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@jenkins-hbase4.apache.org:0 2023-07-24 23:08:56,748 ERROR [Thread[Thread-383,5,FailOnTimeoutGroup]] delegation.AbstractDelegationTokenSecretManager$ExpiredTokenRemover(696): ExpiredTokenRemover received java.lang.InterruptedException: sleep interrupted 2023-07-24 23:08:56,749 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(2765): Mini mapreduce cluster stopped 2023-07-24 23:08:56,749 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-07-24 23:08:56,749 INFO [Listener at jenkins-hbase4.apache.org/36985] client.ConnectionImplementation(1979): Closing master protocol: MasterService 2023-07-24 23:08:56,749 DEBUG [Listener at jenkins-hbase4.apache.org/36985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a248d85 to 127.0.0.1:58202 2023-07-24 23:08:56,749 DEBUG [Listener at jenkins-hbase4.apache.org/36985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:56,749 DEBUG [Listener at jenkins-hbase4.apache.org/36985] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-07-24 23:08:56,750 DEBUG [Listener at jenkins-hbase4.apache.org/36985] util.JVMClusterUtil(257): Found active master hash=600077586, stopped=false 2023-07-24 23:08:56,750 DEBUG [Listener at jenkins-hbase4.apache.org/36985] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:56,750 DEBUG [Listener at jenkins-hbase4.apache.org/36985] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.SecureTestUtil$MasterSyncObserver 2023-07-24 23:08:56,750 INFO [Listener at jenkins-hbase4.apache.org/36985] master.ServerManager(901): Cluster shutdown requested of master=jenkins-hbase4.apache.org,40271,1690239968260 2023-07-24 23:08:56,753 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 23:08:56,753 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 23:08:56,753 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 23:08:56,753 INFO [Listener at jenkins-hbase4.apache.org/36985] procedure2.ProcedureExecutor(629): Stopping 2023-07-24 23:08:56,753 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-07-24 23:08:56,753 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:08:56,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:08:56,753 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:08:56,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:08:56,754 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-07-24 23:08:56,755 DEBUG [Listener at jenkins-hbase4.apache.org/36985] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x02cab362 to 127.0.0.1:58202 2023-07-24 23:08:56,755 DEBUG [Listener at jenkins-hbase4.apache.org/36985] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:56,755 INFO [Listener at jenkins-hbase4.apache.org/36985] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,42121,1690239969723' ***** 2023-07-24 23:08:56,756 DEBUG [Listener at jenkins-hbase4.apache.org/36985] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:56,756 INFO [Listener at jenkins-hbase4.apache.org/36985] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 23:08:56,756 INFO [RS:0;jenkins-hbase4:42121] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 23:08:56,757 INFO [RS:0;jenkins-hbase4:42121] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 23:08:56,757 INFO [RS:0;jenkins-hbase4:42121] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 23:08:56,757 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 23:08:56,757 INFO [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(3305): Received CLOSE for fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:08:56,757 INFO [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:56,757 DEBUG [RS:0;jenkins-hbase4:42121] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3298b845 to 127.0.0.1:58202 2023-07-24 23:08:56,758 DEBUG [RS:0;jenkins-hbase4:42121] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:56,758 INFO [Listener at jenkins-hbase4.apache.org/36985] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,39257,1690239969778' ***** 2023-07-24 23:08:56,758 DEBUG [Listener at jenkins-hbase4.apache.org/36985] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:56,758 INFO [Listener at jenkins-hbase4.apache.org/36985] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 23:08:56,758 INFO [Listener at jenkins-hbase4.apache.org/36985] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,34249,1690239969818' ***** 2023-07-24 23:08:56,758 INFO [RS:1;jenkins-hbase4:39257] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 23:08:56,759 INFO [RS:1;jenkins-hbase4:39257] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 23:08:56,759 INFO [RS:1;jenkins-hbase4:39257] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 23:08:56,759 INFO [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:56,759 DEBUG [RS:1;jenkins-hbase4:39257] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x217a9942 to 127.0.0.1:58202 2023-07-24 23:08:56,759 DEBUG [RS:1;jenkins-hbase4:39257] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:56,759 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 23:08:56,759 DEBUG [Listener at jenkins-hbase4.apache.org/36985] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:56,759 INFO [Listener at jenkins-hbase4.apache.org/36985] regionserver.HRegionServer(2311): STOPPED: Shutdown requested 2023-07-24 23:08:56,759 INFO [RS:2;jenkins-hbase4:34249] regionserver.HeapMemoryManager(220): Stopping 2023-07-24 23:08:56,759 INFO [RS:2;jenkins-hbase4:34249] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-07-24 23:08:56,759 INFO [RS:2;jenkins-hbase4:34249] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-07-24 23:08:56,760 INFO [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(3305): Received CLOSE for 79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:08:56,760 INFO [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:56,760 DEBUG [RS:2;jenkins-hbase4:34249] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x558881b3 to 127.0.0.1:58202 2023-07-24 23:08:56,760 DEBUG [RS:2;jenkins-hbase4:34249] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:56,760 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-07-24 23:08:56,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 79bf104c8199353e65a733c8164f1b5d, disabling compactions & flushes 2023-07-24 23:08:56,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fa41a5b8df27de46cbed3841ca3a5369, disabling compactions & flushes 2023-07-24 23:08:56,765 INFO [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 23:08:56,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:08:56,765 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1478): Online Regions={fa41a5b8df27de46cbed3841ca3a5369=hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369.} 2023-07-24 23:08:56,765 INFO [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 23:08:56,766 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1478): Online Regions={79bf104c8199353e65a733c8164f1b5d=hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d.} 2023-07-24 23:08:56,766 DEBUG [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1504): Waiting on 79bf104c8199353e65a733c8164f1b5d 2023-07-24 23:08:56,765 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:08:56,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:08:56,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. after waiting 0 ms 2023-07-24 23:08:56,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:08:56,767 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 79bf104c8199353e65a733c8164f1b5d 1/1 column families, dataSize=914 B heapSize=2.17 KB 2023-07-24 23:08:56,766 DEBUG [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1504): Waiting on fa41a5b8df27de46cbed3841ca3a5369 2023-07-24 23:08:56,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:08:56,765 INFO [RS:1;jenkins-hbase4:39257] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 23:08:56,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. after waiting 0 ms 2023-07-24 23:08:56,768 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:08:56,768 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fa41a5b8df27de46cbed3841ca3a5369 1/1 column families, dataSize=78 B heapSize=488 B 2023-07-24 23:08:56,768 INFO [RS:1;jenkins-hbase4:39257] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 23:08:56,770 INFO [RS:1;jenkins-hbase4:39257] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 23:08:56,771 INFO [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(3305): Received CLOSE for 1588230740 2023-07-24 23:08:56,786 INFO [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1474): Waiting on 1 regions to close 2023-07-24 23:08:56,787 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1478): Online Regions={1588230740=hbase:meta,,1.1588230740} 2023-07-24 23:08:56,787 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 23:08:56,789 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-07-24 23:08:56,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-07-24 23:08:56,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-07-24 23:08:56,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-07-24 23:08:56,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-07-24 23:08:56,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=45.93 KB heapSize=71.92 KB 2023-07-24 23:08:56,809 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:56,825 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-24 23:08:56,825 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-24 23:08:56,825 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-24 23:08:56,825 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-24 23:08:56,833 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:56,834 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:56,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=78 B at sequenceid=6 (bloomFilter=true), to=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369/.tmp/info/bf1f7909c518445e866f11512c4aa256 2023-07-24 23:08:56,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=914 B at sequenceid=18 (bloomFilter=false), to=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d/.tmp/l/6d4edf32cef349db9ec077646d9aea49 2023-07-24 23:08:56,885 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d4edf32cef349db9ec077646d9aea49 2023-07-24 23:08:56,887 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d/.tmp/l/6d4edf32cef349db9ec077646d9aea49 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d/l/6d4edf32cef349db9ec077646d9aea49 2023-07-24 23:08:56,888 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369/.tmp/info/bf1f7909c518445e866f11512c4aa256 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369/info/bf1f7909c518445e866f11512c4aa256 2023-07-24 23:08:56,892 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369/info/bf1f7909c518445e866f11512c4aa256, entries=2, sequenceid=6, filesize=4.8 K 2023-07-24 23:08:56,893 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~78 B/78, heapSize ~472 B/472, currentSize=0 B/0 for fa41a5b8df27de46cbed3841ca3a5369 in 125ms, sequenceid=6, compaction requested=false 2023-07-24 23:08:56,895 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=40.45 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/.tmp/info/894cf0c7de624fc1885e35143ac36e5c 2023-07-24 23:08:56,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6d4edf32cef349db9ec077646d9aea49 2023-07-24 23:08:56,903 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d/l/6d4edf32cef349db9ec077646d9aea49, entries=7, sequenceid=18, filesize=5.2 K 2023-07-24 23:08:56,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 894cf0c7de624fc1885e35143ac36e5c 2023-07-24 23:08:56,904 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~914 B/914, heapSize ~2.16 KB/2208, currentSize=0 B/0 for 79bf104c8199353e65a733c8164f1b5d in 137ms, sequenceid=18, compaction requested=false 2023-07-24 23:08:56,904 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-07-24 23:08:56,906 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-07-24 23:08:56,906 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/namespace/fa41a5b8df27de46cbed3841ca3a5369/recovered.edits/9.seqid, newMaxSeqId=9, maxSeqId=1 2023-07-24 23:08:56,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:56,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:08:56,910 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fa41a5b8df27de46cbed3841ca3a5369: 2023-07-24 23:08:56,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1690239972555.fa41a5b8df27de46cbed3841ca3a5369. 2023-07-24 23:08:56,913 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/acl/79bf104c8199353e65a733c8164f1b5d/recovered.edits/21.seqid, newMaxSeqId=21, maxSeqId=1 2023-07-24 23:08:56,914 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:56,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:08:56,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 79bf104c8199353e65a733c8164f1b5d: 2023-07-24 23:08:56,915 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:acl,,1690239973421.79bf104c8199353e65a733c8164f1b5d. 2023-07-24 23:08:56,921 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.50 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/.tmp/rep_barrier/7f357986b7e24d2fa5455c3832961a19 2023-07-24 23:08:56,926 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f357986b7e24d2fa5455c3832961a19 2023-07-24 23:08:56,944 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=3.98 KB at sequenceid=131 (bloomFilter=false), to=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/.tmp/table/59fae6be28e94c539507ffd43bfa4266 2023-07-24 23:08:56,949 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59fae6be28e94c539507ffd43bfa4266 2023-07-24 23:08:56,950 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/.tmp/info/894cf0c7de624fc1885e35143ac36e5c as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/info/894cf0c7de624fc1885e35143ac36e5c 2023-07-24 23:08:56,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 894cf0c7de624fc1885e35143ac36e5c 2023-07-24 23:08:56,957 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/info/894cf0c7de624fc1885e35143ac36e5c, entries=48, sequenceid=131, filesize=10.3 K 2023-07-24 23:08:56,958 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/.tmp/rep_barrier/7f357986b7e24d2fa5455c3832961a19 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/rep_barrier/7f357986b7e24d2fa5455c3832961a19 2023-07-24 23:08:56,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7f357986b7e24d2fa5455c3832961a19 2023-07-24 23:08:56,962 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/rep_barrier/7f357986b7e24d2fa5455c3832961a19, entries=13, sequenceid=131, filesize=6.4 K 2023-07-24 23:08:56,963 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/.tmp/table/59fae6be28e94c539507ffd43bfa4266 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/table/59fae6be28e94c539507ffd43bfa4266 2023-07-24 23:08:56,967 INFO [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,34249,1690239969818; all regions closed. 2023-07-24 23:08:56,968 INFO [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,42121,1690239969723; all regions closed. 2023-07-24 23:08:56,968 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 59fae6be28e94c539507ffd43bfa4266 2023-07-24 23:08:56,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/table/59fae6be28e94c539507ffd43bfa4266, entries=24, sequenceid=131, filesize=6.9 K 2023-07-24 23:08:56,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~45.93 KB/47028, heapSize ~71.88 KB/73600, currentSize=0 B/0 for 1588230740 in 179ms, sequenceid=131, compaction requested=false 2023-07-24 23:08:56,987 DEBUG [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1504): Waiting on 1588230740 2023-07-24 23:08:56,988 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/data/hbase/meta/1588230740/recovered.edits/134.seqid, newMaxSeqId=134, maxSeqId=1 2023-07-24 23:08:56,989 DEBUG [RS:0;jenkins-hbase4:42121] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/oldWALs 2023-07-24 23:08:56,989 INFO [RS:0;jenkins-hbase4:42121] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42121%2C1690239969723:(num 1690239972059) 2023-07-24 23:08:56,989 DEBUG [RS:2;jenkins-hbase4:34249] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/oldWALs 2023-07-24 23:08:56,989 INFO [RS:2;jenkins-hbase4:34249] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34249%2C1690239969818:(num 1690239972033) 2023-07-24 23:08:56,989 DEBUG [RS:0;jenkins-hbase4:42121] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:56,989 DEBUG [RS:2;jenkins-hbase4:34249] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:56,989 INFO [RS:0;jenkins-hbase4:42121] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:56,990 INFO [RS:0;jenkins-hbase4:42121] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 23:08:56,990 INFO [RS:0;jenkins-hbase4:42121] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 23:08:56,990 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 23:08:56,989 INFO [RS:2;jenkins-hbase4:34249] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:56,990 INFO [RS:0;jenkins-hbase4:42121] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 23:08:56,991 INFO [RS:0;jenkins-hbase4:42121] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 23:08:56,991 INFO [RS:2;jenkins-hbase4:34249] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2023-07-24 23:08:56,991 INFO [RS:2;jenkins-hbase4:34249] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-07-24 23:08:56,991 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.security.access.AccessController 2023-07-24 23:08:56,991 INFO [RS:2;jenkins-hbase4:34249] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-07-24 23:08:56,992 INFO [RS:2;jenkins-hbase4:34249] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-07-24 23:08:56,991 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 23:08:56,992 INFO [RS:0;jenkins-hbase4:42121] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42121 2023-07-24 23:08:56,992 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-07-24 23:08:56,993 INFO [RS:2;jenkins-hbase4:34249] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34249 2023-07-24 23:08:56,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-07-24 23:08:56,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-07-24 23:08:56,994 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-07-24 23:08:56,999 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:56,999 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:56,999 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42121,1690239969723 2023-07-24 23:08:56,999 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:56,999 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:56,999 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:56,999 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:57,000 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:57,000 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:57,001 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34249,1690239969818 2023-07-24 23:08:57,001 ERROR [Listener at localhost/36183-EventThread] zookeeper.ClientCnxn$EventThread(537): Error while calling watcher java.util.concurrent.RejectedExecutionException: Task java.util.concurrent.FutureTask@5eb1ab3a rejected from java.util.concurrent.ThreadPoolExecutor@5a8e2434[Shutting down, pool size = 1, active threads = 0, queued tasks = 0, completed tasks = 110] at java.util.concurrent.ThreadPoolExecutor$AbortPolicy.rejectedExecution(ThreadPoolExecutor.java:2063) at java.util.concurrent.ThreadPoolExecutor.reject(ThreadPoolExecutor.java:830) at java.util.concurrent.ThreadPoolExecutor.execute(ThreadPoolExecutor.java:1374) at java.util.concurrent.AbstractExecutorService.submit(AbstractExecutorService.java:112) at java.util.concurrent.Executors$DelegatedExecutorService.submit(Executors.java:678) at org.apache.hadoop.hbase.zookeeper.ZKWatcher.process(ZKWatcher.java:603) at org.apache.zookeeper.ClientCnxn$EventThread.processEvent(ClientCnxn.java:535) at org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:510) 2023-07-24 23:08:57,002 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42121,1690239969723] 2023-07-24 23:08:57,003 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42121,1690239969723; numProcessing=1 2023-07-24 23:08:57,004 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42121,1690239969723 already deleted, retry=false 2023-07-24 23:08:57,005 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,42121,1690239969723 expired; onlineServers=2 2023-07-24 23:08:57,005 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34249,1690239969818] 2023-07-24 23:08:57,005 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34249,1690239969818; numProcessing=2 2023-07-24 23:08:57,006 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34249,1690239969818 already deleted, retry=false 2023-07-24 23:08:57,006 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,34249,1690239969818 expired; onlineServers=1 2023-07-24 23:08:57,103 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:57,103 INFO [RS:0;jenkins-hbase4:42121] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,42121,1690239969723; zookeeper connection closed. 2023-07-24 23:08:57,103 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:42121-0x1019995a32f0001, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:57,103 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c3b5c05] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c3b5c05 2023-07-24 23:08:57,187 INFO [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,39257,1690239969778; all regions closed. 2023-07-24 23:08:57,193 DEBUG [RS:1;jenkins-hbase4:39257] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/oldWALs 2023-07-24 23:08:57,193 INFO [RS:1;jenkins-hbase4:39257] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39257%2C1690239969778.meta:.meta(num 1690239972199) 2023-07-24 23:08:57,199 DEBUG [RS:1;jenkins-hbase4:39257] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/oldWALs 2023-07-24 23:08:57,199 INFO [RS:1;jenkins-hbase4:39257] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39257%2C1690239969778:(num 1690239972052) 2023-07-24 23:08:57,199 DEBUG [RS:1;jenkins-hbase4:39257] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:57,199 INFO [RS:1;jenkins-hbase4:39257] regionserver.LeaseManager(133): Closed leases 2023-07-24 23:08:57,199 INFO [RS:1;jenkins-hbase4:39257] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-07-24 23:08:57,199 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 23:08:57,200 INFO [RS:1;jenkins-hbase4:39257] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39257 2023-07-24 23:08:57,203 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39257,1690239969778 2023-07-24 23:08:57,203 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-07-24 23:08:57,203 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:57,203 INFO [RS:2;jenkins-hbase4:34249] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,34249,1690239969818; zookeeper connection closed. 2023-07-24 23:08:57,203 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:34249-0x1019995a32f0003, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:57,203 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7c9a1485] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7c9a1485 2023-07-24 23:08:57,204 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39257,1690239969778] 2023-07-24 23:08:57,204 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39257,1690239969778; numProcessing=3 2023-07-24 23:08:57,205 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39257,1690239969778 already deleted, retry=false 2023-07-24 23:08:57,205 INFO [RegionServerTracker-0] master.ServerManager(561): Cluster shutdown set; jenkins-hbase4.apache.org,39257,1690239969778 expired; onlineServers=0 2023-07-24 23:08:57,205 INFO [RegionServerTracker-0] regionserver.HRegionServer(2297): ***** STOPPING region server 'jenkins-hbase4.apache.org,40271,1690239968260' ***** 2023-07-24 23:08:57,205 INFO [RegionServerTracker-0] regionserver.HRegionServer(2311): STOPPED: Cluster shutdown set; onlineServer=0 2023-07-24 23:08:57,206 DEBUG [M:0;jenkins-hbase4:40271] ipc.AbstractRpcClient(190): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@62f97f29, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-07-24 23:08:57,206 INFO [M:0;jenkins-hbase4:40271] regionserver.HRegionServer(1144): stopping server jenkins-hbase4.apache.org,40271,1690239968260 2023-07-24 23:08:57,206 INFO [M:0;jenkins-hbase4:40271] regionserver.HRegionServer(1170): stopping server jenkins-hbase4.apache.org,40271,1690239968260; all regions closed. 2023-07-24 23:08:57,206 DEBUG [M:0;jenkins-hbase4:40271] ipc.AbstractRpcClient(494): Stopping rpc client 2023-07-24 23:08:57,206 DEBUG [M:0;jenkins-hbase4:40271] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-07-24 23:08:57,206 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-07-24 23:08:57,206 DEBUG [M:0;jenkins-hbase4:40271] cleaner.HFileCleaner(317): Stopping file delete threads 2023-07-24 23:08:57,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690239971494] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1690239971494,5,FailOnTimeoutGroup] 2023-07-24 23:08:57,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690239971492] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1690239971492,5,FailOnTimeoutGroup] 2023-07-24 23:08:57,206 INFO [M:0;jenkins-hbase4:40271] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-07-24 23:08:57,206 INFO [M:0;jenkins-hbase4:40271] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-07-24 23:08:57,206 INFO [M:0;jenkins-hbase4:40271] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-07-24 23:08:57,207 DEBUG [M:0;jenkins-hbase4:40271] master.HMaster(1512): Stopping service threads 2023-07-24 23:08:57,207 INFO [M:0;jenkins-hbase4:40271] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-07-24 23:08:57,207 ERROR [M:0;jenkins-hbase4:40271] procedure2.ProcedureExecutor(653): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-22,5,PEWorkerGroup] Thread[HFileArchiver-23,5,PEWorkerGroup] 2023-07-24 23:08:57,207 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-07-24 23:08:57,207 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-07-24 23:08:57,207 INFO [M:0;jenkins-hbase4:40271] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-07-24 23:08:57,208 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-07-24 23:08:57,208 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(164): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-07-24 23:08:57,208 DEBUG [M:0;jenkins-hbase4:40271] zookeeper.ZKUtil(398): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-07-24 23:08:57,208 WARN [M:0;jenkins-hbase4:40271] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-07-24 23:08:57,208 INFO [M:0;jenkins-hbase4:40271] assignment.AssignmentManager(315): Stopping assignment manager 2023-07-24 23:08:57,208 INFO [M:0;jenkins-hbase4:40271] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-07-24 23:08:57,209 DEBUG [M:0;jenkins-hbase4:40271] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-07-24 23:08:57,209 INFO [M:0;jenkins-hbase4:40271] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:08:57,209 DEBUG [M:0;jenkins-hbase4:40271] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:08:57,209 DEBUG [M:0;jenkins-hbase4:40271] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-07-24 23:08:57,209 DEBUG [M:0;jenkins-hbase4:40271] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:08:57,209 INFO [M:0;jenkins-hbase4:40271] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=375.65 KB heapSize=451.93 KB 2023-07-24 23:08:57,225 INFO [M:0;jenkins-hbase4:40271] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=375.65 KB at sequenceid=899 (bloomFilter=true), to=hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7a07b54cf2c5409b96ee976ea59ca541 2023-07-24 23:08:57,230 INFO [M:0;jenkins-hbase4:40271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a07b54cf2c5409b96ee976ea59ca541 2023-07-24 23:08:57,230 DEBUG [M:0;jenkins-hbase4:40271] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/7a07b54cf2c5409b96ee976ea59ca541 as hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7a07b54cf2c5409b96ee976ea59ca541 2023-07-24 23:08:57,236 INFO [M:0;jenkins-hbase4:40271] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7a07b54cf2c5409b96ee976ea59ca541 2023-07-24 23:08:57,237 INFO [M:0;jenkins-hbase4:40271] regionserver.HStore(1080): Added hdfs://localhost:33513/user/jenkins/test-data/8a82671e-2a56-830c-9e16-723db19f4316/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/7a07b54cf2c5409b96ee976ea59ca541, entries=119, sequenceid=899, filesize=28.6 K 2023-07-24 23:08:57,237 INFO [M:0;jenkins-hbase4:40271] regionserver.HRegion(2948): Finished flush of dataSize ~375.65 KB/384670, heapSize ~451.91 KB/462760, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 28ms, sequenceid=899, compaction requested=false 2023-07-24 23:08:57,239 INFO [M:0;jenkins-hbase4:40271] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-07-24 23:08:57,239 DEBUG [M:0;jenkins-hbase4:40271] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-07-24 23:08:57,245 INFO [M:0;jenkins-hbase4:40271] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-07-24 23:08:57,245 INFO [M:0;jenkins-hbase4:40271] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40271 2023-07-24 23:08:57,245 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-07-24 23:08:57,248 DEBUG [M:0;jenkins-hbase4:40271] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,40271,1690239968260 already deleted, retry=false 2023-07-24 23:08:57,305 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:57,305 INFO [RS:1;jenkins-hbase4:39257] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,39257,1690239969778; zookeeper connection closed. 2023-07-24 23:08:57,305 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): regionserver:39257-0x1019995a32f0002, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:57,305 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@467e0603] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@467e0603 2023-07-24 23:08:57,305 INFO [Listener at jenkins-hbase4.apache.org/36985] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 3 regionserver(s) complete 2023-07-24 23:08:57,405 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:57,405 DEBUG [Listener at localhost/36183-EventThread] zookeeper.ZKWatcher(600): master:40271-0x1019995a32f0000, quorum=127.0.0.1:58202, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-07-24 23:08:57,405 INFO [M:0;jenkins-hbase4:40271] regionserver.HRegionServer(1227): Exiting; stopping=jenkins-hbase4.apache.org,40271,1690239968260; zookeeper connection closed. 2023-07-24 23:08:57,407 WARN [Listener at jenkins-hbase4.apache.org/36985] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 23:08:57,415 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 23:08:57,519 WARN [BP-1885114463-172.31.14.131-1690239964205 heartbeating to localhost/127.0.0.1:33513] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 23:08:57,520 WARN [BP-1885114463-172.31.14.131-1690239964205 heartbeating to localhost/127.0.0.1:33513] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1885114463-172.31.14.131-1690239964205 (Datanode Uuid a3c71bc2-f8e3-4a26-a336-625b15361ced) service to localhost/127.0.0.1:33513 2023-07-24 23:08:57,521 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data5/current/BP-1885114463-172.31.14.131-1690239964205] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:57,521 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data6/current/BP-1885114463-172.31.14.131-1690239964205] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:57,523 WARN [Listener at jenkins-hbase4.apache.org/36985] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 23:08:57,548 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 23:08:57,651 WARN [BP-1885114463-172.31.14.131-1690239964205 heartbeating to localhost/127.0.0.1:33513] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 23:08:57,651 WARN [BP-1885114463-172.31.14.131-1690239964205 heartbeating to localhost/127.0.0.1:33513] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1885114463-172.31.14.131-1690239964205 (Datanode Uuid d7990bff-f30d-439f-96fa-79a872e88701) service to localhost/127.0.0.1:33513 2023-07-24 23:08:57,652 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data3/current/BP-1885114463-172.31.14.131-1690239964205] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:57,652 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data4/current/BP-1885114463-172.31.14.131-1690239964205] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:57,654 WARN [Listener at jenkins-hbase4.apache.org/36985] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-07-24 23:08:57,678 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 23:08:57,680 WARN [BP-1885114463-172.31.14.131-1690239964205 heartbeating to localhost/127.0.0.1:33513] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-07-24 23:08:57,680 WARN [BP-1885114463-172.31.14.131-1690239964205 heartbeating to localhost/127.0.0.1:33513] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1885114463-172.31.14.131-1690239964205 (Datanode Uuid 3b1b6036-b5b3-4b73-8b8e-9e94ff1870a5) service to localhost/127.0.0.1:33513 2023-07-24 23:08:57,681 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data1/current/BP-1885114463-172.31.14.131-1690239964205] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:57,681 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-mapreduce/target/test-data/b5f4a240-8d44-b8f9-40cf-06731f3cfa2a/cluster_6a004722-3b61-5e4c-7591-4c2c126f3c83/dfs/data/data2/current/BP-1885114463-172.31.14.131-1690239964205] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-07-24 23:08:57,705 INFO [Listener at jenkins-hbase4.apache.org/36985] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-07-24 23:08:57,833 INFO [Listener at jenkins-hbase4.apache.org/36985] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-07-24 23:08:57,931 INFO [Listener at jenkins-hbase4.apache.org/36985] hbase.HBaseTestingUtility(1293): Minicluster is down